-- Logs begin at Tue 2022-07-05 15:10:44 UTC, end at Tue 2022-07-05 16:32:17 UTC. -- Jul 05 16:00:08.163900 dv-cinder-848759-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 05 16:00:08.172836 dv-cinder-848759-1-iscsi devstack@n-api.service[103796]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 05 16:00:08.174763 dv-cinder-848759-1-iscsi devstack@n-api.service[103796]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 5 16:00:08 2022] *** Jul 05 16:00:08.174763 dv-cinder-848759-1-iscsi devstack@n-api.service[103796]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 05 16:00:08.174763 dv-cinder-848759-1-iscsi devstack@n-api.service[103796]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 05 16:00:08.174763 dv-cinder-848759-1-iscsi devstack@n-api.service[103796]: nodename: dv-cinder-848759-1-iscsi Jul 05 16:00:08.174763 dv-cinder-848759-1-iscsi devstack@n-api.service[103796]: machine: x86_64 Jul 05 16:00:08.174763 dv-cinder-848759-1-iscsi devstack@n-api.service[103796]: clock source: unix Jul 05 16:00:08.174763 dv-cinder-848759-1-iscsi devstack@n-api.service[103796]: pcre jit disabled Jul 05 16:00:08.174763 dv-cinder-848759-1-iscsi devstack@n-api.service[103796]: detected number of CPU cores: 4 Jul 05 16:00:08.174763 dv-cinder-848759-1-iscsi devstack@n-api.service[103796]: current working directory: / Jul 05 16:00:08.174763 dv-cinder-848759-1-iscsi devstack@n-api.service[103796]: detected binary path: /usr/bin/uwsgi-core Jul 05 16:00:08.175457 dv-cinder-848759-1-iscsi devstack@n-api.service[103796]: your processes number limit is 47680 Jul 05 16:00:08.175457 dv-cinder-848759-1-iscsi devstack@n-api.service[103796]: your memory page size is 4096 bytes Jul 05 16:00:08.175457 dv-cinder-848759-1-iscsi devstack@n-api.service[103796]: detected max file descriptor number: 2048 Jul 05 16:00:08.175457 dv-cinder-848759-1-iscsi devstack@n-api.service[103796]: lock engine: pthread robust mutexes Jul 05 16:00:08.175457 dv-cinder-848759-1-iscsi devstack@n-api.service[103796]: thunder lock: enabled Jul 05 16:00:08.175457 dv-cinder-848759-1-iscsi devstack@n-api.service[103796]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 05 16:00:08.175457 dv-cinder-848759-1-iscsi devstack@n-api.service[103796]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 05 16:00:08.218794 dv-cinder-848759-1-iscsi devstack@n-api.service[103796]: Python main interpreter initialized at 0x55f6b78229c0 Jul 05 16:00:08.218794 dv-cinder-848759-1-iscsi devstack@n-api.service[103796]: python threads support enabled Jul 05 16:00:08.218794 dv-cinder-848759-1-iscsi devstack@n-api.service[103796]: your server socket listen backlog is limited to 100 connections Jul 05 16:00:08.218794 dv-cinder-848759-1-iscsi devstack@n-api.service[103796]: your mercy for graceful operations on workers is 90 seconds Jul 05 16:00:08.219112 dv-cinder-848759-1-iscsi devstack@n-api.service[103796]: mapped 403077 bytes (393 KB) for 2 cores Jul 05 16:00:08.219188 dv-cinder-848759-1-iscsi devstack@n-api.service[103796]: *** Operational MODE: preforking *** Jul 05 16:00:08.219443 dv-cinder-848759-1-iscsi devstack@n-api.service[103796]: *** uWSGI is running in multiple interpreter mode *** Jul 05 16:00:08.219443 dv-cinder-848759-1-iscsi devstack@n-api.service[103796]: spawned uWSGI master process (pid: 103796) Jul 05 16:00:08.219617 dv-cinder-848759-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 05 16:00:08.220149 dv-cinder-848759-1-iscsi devstack@n-api.service[103796]: spawned uWSGI worker 1 (pid: 103797, cores: 1) Jul 05 16:00:08.220481 dv-cinder-848759-1-iscsi devstack@n-api.service[103796]: spawned uWSGI worker 2 (pid: 103798, cores: 1) Jul 05 16:00:08.221357 dv-cinder-848759-1-iscsi devstack@n-api.service[103796]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 05 16:00:08.874615 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 05 16:00:08.900570 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 05 16:00:09.989025 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 16:00:09.989025 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: from cryptography.utils import int_from_bytes Jul 05 16:00:09.989659 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 16:00:09.989659 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: from cryptography.utils import int_from_bytes Jul 05 16:00:09.989832 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 16:00:09.989832 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: from cryptography.utils import int_from_bytes Jul 05 16:00:09.990310 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 16:00:09.990310 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: from cryptography.utils import int_from_bytes Jul 05 16:00:12.449222 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 16:00:12.449776 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 16:00:12.449872 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 16:00:12.449872 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 16:00:12.450287 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 16:00:12.450364 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 16:00:12.450437 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 16:00:12.450571 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 16:00:12.450694 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 16:00:12.450949 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.451050 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 16:00:12.451276 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.451368 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.451597 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.451691 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.451914 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.452012 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.452242 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.452335 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.452553 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.452665 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.452902 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.453003 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.453222 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.453308 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.453544 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.453661 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.453806 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.453940 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.454118 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.454220 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.454431 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.454523 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848759-1-iscsi {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.454749 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.454841 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848759-1-iscsi {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.455057 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.455148 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.455365 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.455472 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.455715 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.456022 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.456170 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.456343 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.456505 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.456679 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.456856 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.457054 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.457157 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.457383 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.457593 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.457901 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.458211 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.458306 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.458546 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.458646 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.458862 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.458957 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.459173 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.459289 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.459490 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.459781 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.459972 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.460117 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.460244 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.460404 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.460508 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.460814 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848759-1-iscsi {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.460916 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.461132 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.461312 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.461443 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.461756 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.461876 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.462168 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.462431 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.462540 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.462775 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.463098 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848759-1-iscsi {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.463187 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.463517 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.463677 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.463902 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.466604 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.466732 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.466829 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.467322 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.467418 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.467500 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.467596 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.467687 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.467772 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.467856 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.467939 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.468023 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.468113 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.468199 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.468282 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.468366 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.468443 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.468525 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.468525 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.468690 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.468785 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.468864 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.468970 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.469063 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.469149 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.469233 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.469317 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.469394 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.469477 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.469569 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.469654 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.469732 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.469808 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.469885 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.470102 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.470199 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.470293 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.470431 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.470514 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.470599 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.470686 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.470771 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.470849 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.470932 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.471010 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.471093 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.471715 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.471890 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.472010 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.472144 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.472318 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.472469 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.472816 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.472920 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.473110 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.473197 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.473419 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.473513 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.473731 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.473826 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.474085 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.474182 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.474342 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.474437 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.474657 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.474749 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.474963 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.475059 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.475271 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.475357 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.475589 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.475682 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.475907 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.475992 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.476214 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.476299 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.476524 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.476610 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.476864 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.476963 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.477174 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.477268 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.477479 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.477566 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.477786 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.477878 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.478105 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.478200 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.478434 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.478526 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.478738 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.478835 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.478986 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.479072 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.479287 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.479372 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.479590 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.479685 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.479906 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.479998 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.480202 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.480302 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.480510 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.480613 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.480840 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.480928 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.481143 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.481239 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.481678 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.481780 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.481983 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.482070 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.482286 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.482380 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.482591 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.482685 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.482895 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.482987 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.483198 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.483290 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.483502 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.483594 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.483803 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.483890 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.484105 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.484266 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.484408 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.484495 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.484720 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.484828 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.485052 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.485137 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.485354 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.485440 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.485655 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.485747 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.485960 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.486057 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.486263 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.486349 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.486567 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.486653 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.487416 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.487521 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.487754 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.487841 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.488061 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.488145 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.488366 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.488452 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.488685 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.488820 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.489015 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.489115 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.489323 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.489409 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.489637 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.489770 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.489935 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.490027 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.490249 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.490383 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.490551 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.490666 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.490854 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.490958 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.491154 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.491256 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.491456 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.491550 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.491758 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.491852 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.492060 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.492164 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.492360 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.492461 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.492658 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.492758 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.492984 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.493091 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.493281 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.493378 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.493583 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.493666 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.493886 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.493985 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.494192 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.494348 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.494492 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.494622 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.494766 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.494908 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.495080 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.495228 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.495376 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.495511 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.495657 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.495800 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.495972 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.496112 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.496292 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.496423 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.496601 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.496739 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.496932 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.497029 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.497239 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.497325 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.497558 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:00:12.497646 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.497899 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.497987 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.498236 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.498332 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.498546 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.498631 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.498859 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.498951 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.499171 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.499267 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.499493 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.499579 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.499811 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.499905 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.500141 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.500240 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.500447 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.500534 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.500759 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.500911 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.501079 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.501242 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.501385 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.501522 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.501697 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.501834 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.502017 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.502161 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.502336 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.502483 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.502694 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.502837 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.503013 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.503169 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.503336 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.503472 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.503658 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.503789 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.503972 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.504122 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.504292 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.504380 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.504605 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.504744 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.504939 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.505077 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.505252 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.505391 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.505573 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.505713 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.505911 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.506053 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.506224 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.506355 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.506543 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.506679 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.506855 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.507001 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.507149 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.507289 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.507463 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.507614 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.507774 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.507918 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.508084 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.508231 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.508417 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.508555 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.508730 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.508893 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.509069 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.509214 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.509381 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.509524 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.509695 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.509827 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.510004 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.510144 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.510315 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.510567 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.510705 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.510848 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.510985 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.511124 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.511282 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.511416 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.511557 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.511691 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.511825 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.511959 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.512101 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.512233 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.512366 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.512505 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.512690 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.512846 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.513021 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.513162 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.513354 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.513489 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.513662 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.513798 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.513973 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.514116 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.514282 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.514369 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.514590 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.514720 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.514896 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.515059 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.515206 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.515293 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.515517 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.515612 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.515822 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.515908 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.516144 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.516237 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.516452 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.516554 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.516757 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.516881 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.517092 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.517177 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.517394 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.517491 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.517699 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.517795 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.518007 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.518092 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.518340 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.518438 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.518651 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.518737 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.518960 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.519047 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.519265 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.519351 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.519584 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.519670 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.519891 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.519976 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.520199 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.520286 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.520514 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.520640 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.520849 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.520951 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.521164 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.521250 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.521473 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.521558 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.521786 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.521881 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.522103 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.522195 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.522408 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.522495 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.522717 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.522811 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.523021 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.523107 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.523325 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.523412 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.523628 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.523723 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.523935 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.524020 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.524239 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.524334 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.524541 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.524681 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.524916 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.525017 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.525220 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.525305 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.525524 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.525619 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.525826 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.525910 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.526131 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.526217 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.526431 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.526519 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.526735 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.526849 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.527039 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.527128 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.527340 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.527433 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.527645 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.527740 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.527948 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.528035 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.528272 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.528359 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.528583 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.528677 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.528920 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.529025 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.529225 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.529312 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.529530 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.529615 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.529857 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.529950 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.530168 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.530253 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.530478 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.530571 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.530792 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.530886 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.531114 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.531201 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.531425 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.531510 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.531745 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.531839 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.532057 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.532144 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.532368 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.532453 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.532677 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.532819 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.533018 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.533115 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.533324 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.533409 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.533641 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.534235 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.534486 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.534578 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.534810 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.534895 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.535124 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.535216 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.535447 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.535533 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.535758 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.535843 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.536071 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.536170 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.536377 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.536462 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.536687 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.536794 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.537023 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.537111 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.537334 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.537421 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.537653 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.537748 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.537966 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.538052 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.538284 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.538369 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.538595 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.538689 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.538903 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.538987 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.539217 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.539304 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.539532 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.539697 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.539835 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.539920 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.540149 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.540235 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.540460 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.540558 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.540803 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.540893 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.541158 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.541251 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.541421 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.541516 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.541735 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.541827 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.542046 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.542131 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.542351 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.542438 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.542660 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.542744 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.542965 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.543051 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.543270 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.543358 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.543578 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.543671 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.543891 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.543984 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.544201 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.544288 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.544510 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.544596 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.544835 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.544932 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.545151 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.545246 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.545460 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.545546 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.545763 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.545856 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.546065 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.546158 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.546375 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.546468 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.546686 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.546780 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.546994 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.547078 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.547299 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.547385 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.547615 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.547712 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.547917 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.548002 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.548219 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.548305 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.548524 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.548617 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.548860 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.548951 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.549168 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.549265 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.550010 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.550101 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.550318 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.550405 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.550643 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.550735 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.550952 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.551043 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.551257 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.551342 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.551578 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.551664 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.551886 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.551973 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.552193 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.552279 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.552499 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.552649 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.552829 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.552921 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.553141 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.553225 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.553464 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.553566 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.553772 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.553856 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.554079 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.554164 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.554389 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.554483 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.554698 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.554782 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.555006 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.555090 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.555316 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.555411 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.555625 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.555709 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.555934 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.556019 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.556243 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.556339 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.556551 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.556644 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.556879 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.556980 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.557190 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.557277 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.557499 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.557584 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.557811 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.558069 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.558168 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.558403 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.558497 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.558719 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.558805 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.559027 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.559120 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.559334 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.559420 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.559645 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.559733 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.559963 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.560058 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.560289 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.560532 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.560618 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.560893 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.560995 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.561214 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.561313 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.561539 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.561625 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.561844 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.561935 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.562157 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.562251 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.562464 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.562557 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.562773 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.562859 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.563077 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.563164 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.563387 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.563482 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.563691 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.563784 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.563996 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.564162 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.564301 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.564396 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.564605 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.564698 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.564965 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.565106 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.565272 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.565359 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.565579 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.565664 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.565880 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.565974 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.566189 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.566273 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.566497 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.566770 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.566895 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.567015 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.567147 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.567231 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.567379 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.567470 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.567691 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.567786 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.568004 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.568090 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.568310 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.568397 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.568633 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.568728 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.568971 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.569071 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.569278 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.569372 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.569584 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.569673 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.569890 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.569976 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.570197 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.570284 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.570509 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.570604 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.570815 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.570901 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.571125 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.571230 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.571433 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.571519 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.571738 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.571834 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.572049 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.572148 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.572357 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.572444 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.572667 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.572754 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.573000 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.573100 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.573304 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.573389 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.573611 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.573696 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.573917 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.574019 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.574232 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.574327 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.574539 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.574625 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.574845 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.574933 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.575149 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.575240 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.575456 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.575541 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.575761 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.575847 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.576062 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.576148 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.576363 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.576448 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.576663 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.576757 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.577003 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.577100 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.577309 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.577394 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.577613 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.577700 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.577918 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.578012 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.578224 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.578322 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.578529 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.578616 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.578829 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.578914 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.579131 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.579226 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.579449 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.579542 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.579753 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.579846 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.580057 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.580157 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.580363 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.580448 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.580695 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.580802 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.581026 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.581130 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.581337 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.581432 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.581658 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.581744 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.581970 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.582059 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.582272 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.582357 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.582576 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.582661 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.582879 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.582965 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.583184 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.583280 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.583484 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.583578 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.583792 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.583887 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.584096 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.584182 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.584397 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.584490 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.584700 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.584826 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.585030 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.585166 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.585334 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.585431 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.585642 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.585735 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.585949 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.586043 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.586250 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.586344 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.586554 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.586641 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.586856 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.586948 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.587158 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.587252 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.587463 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.587551 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.587770 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.587856 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.588096 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.588195 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.588409 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.588496 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.588715 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.588820 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.589050 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.589149 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.589353 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.589437 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.589663 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.589747 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.589968 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.590055 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.590283 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.590368 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.590599 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.590685 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.590912 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.591005 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.591217 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.591303 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.591520 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.591608 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.591828 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.591915 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.592137 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.592223 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.592440 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.592532 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.592758 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.592863 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.593090 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.593176 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.593405 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.593504 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.593708 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.593794 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.594013 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.594106 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.594320 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.594413 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.594630 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.594715 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.594938 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.595031 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.595245 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.595338 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.595555 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.595642 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.595866 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.595952 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.596692 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.596847 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.597038 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.597125 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.597350 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.597436 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.597658 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.597745 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.597969 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.598062 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.598277 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.598363 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.598582 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.598669 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.598893 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.598979 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.599204 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.599301 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.599509 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.599600 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.599818 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.599904 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.600123 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.600208 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.600432 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.600519 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.600739 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.600894 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.601069 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.601183 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.601396 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.601504 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.601707 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.601801 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.602013 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.602109 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.602324 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.602409 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.602629 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.602714 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.602941 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.603034 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.603247 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.603332 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.603553 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.603673 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.603969 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.604062 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.604281 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.604376 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.604585 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.604676 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.604917 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.605005 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.605224 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.605322 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.605528 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.605623 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.605841 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.605935 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.606145 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.606229 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.606709 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.606821 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.607012 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.607137 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.607317 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.607449 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.607639 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.607760 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.607944 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.608067 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.608263 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.608375 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.608679 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.608803 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.609013 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.609099 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.609320 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.609404 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.609624 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.609716 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.609930 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.610014 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.610255 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.610339 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.610562 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.610655 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.610883 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.610969 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.611257 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.611341 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.611563 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.611664 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.612456 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.612546 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.612794 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.612905 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.613117 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.613225 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.613441 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.613555 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.613754 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.613840 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.614069 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.614154 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.614374 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.614467 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.614696 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.614782 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.615019 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.615111 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.615333 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.615417 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.615657 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.615753 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.616004 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.616088 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.616318 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.616411 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.616633 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.616718 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.616979 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.617082 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.617306 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.617394 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.617610 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.617694 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.617918 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.618012 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.618229 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.618314 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.618534 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.618645 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.618840 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.618970 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.619165 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.619283 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.619471 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.619608 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.619783 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.619934 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.620094 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.620242 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.620405 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.620549 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.620712 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.620884 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.621045 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.621190 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.621370 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.621499 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.621679 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.621823 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.622001 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.622129 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.622314 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.622442 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.622619 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.622752 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.622939 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.623062 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.623243 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.623368 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.623566 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.623675 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.623877 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.624001 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.624182 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.624306 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.624488 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.624629 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.624812 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.624969 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.625155 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.625275 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.625461 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.625622 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.625782 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.625912 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.626112 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.626236 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.626442 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.626534 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.626764 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.626858 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.627084 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.627179 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.627426 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.627520 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.627747 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.627832 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.628064 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.628158 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.628390 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.628482 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.628691 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.628789 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.629023 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.629110 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.629333 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.629427 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.629638 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.629731 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.629941 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.630028 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.630245 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.630330 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.630553 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.630678 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.630856 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.630943 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.631164 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.631248 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.631468 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.631553 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.631789 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.631890 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.632092 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.632176 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.632400 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.632494 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.632705 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.632826 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.633034 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.633118 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.633336 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.633477 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.633641 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.633726 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.633943 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.634030 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.634265 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.634360 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.634571 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.634664 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.634894 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.634987 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.635206 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.635304 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.635517 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.635604 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.635824 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.635919 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.636130 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.636217 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.636444 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.636530 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.636779 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.636879 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.637096 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.637190 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.637412 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.637498 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.637730 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.637816 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.638045 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.638139 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.638361 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.638454 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.638669 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.638762 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.638985 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.639079 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.639301 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.639394 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.639617 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.639711 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.639935 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.640136 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.640255 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.640468 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.640556 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.640811 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.640905 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.641127 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.641226 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.641442 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.641528 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.641758 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.641845 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.642071 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.642159 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.642385 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.642620 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.642719 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.642953 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.643039 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.643321 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.643407 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.643641 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.643728 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.643957 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.644043 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.644276 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.644362 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.644595 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.644681 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.644941 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.645028 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.645258 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.645342 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.645575 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.645668 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.645887 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.645981 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.646218 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.646313 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.646544 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.646628 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.646851 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.646936 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.647165 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.647259 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.647482 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.647567 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.647798 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.647890 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.648112 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.648200 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.648424 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.648508 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.648739 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.648869 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.649081 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.649168 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.649393 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.649481 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.649705 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.649801 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.650021 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.650162 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.650334 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.650421 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.650647 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.650753 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.650960 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.651047 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.651276 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.651368 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.651591 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.651689 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.651902 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.651986 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.652213 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.652302 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.652529 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.652728 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.652871 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.653068 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.653200 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.653403 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.653536 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.653729 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.653858 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.654053 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.654174 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.654371 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.654491 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.654688 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.654808 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.655016 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.655330 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.655447 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.655637 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.655747 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.655999 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.656111 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.656254 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.656365 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.656561 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.656660 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.656905 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.657003 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.657226 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.657327 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.657555 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.657643 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.657866 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.657954 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.658175 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.658276 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.658489 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.659219 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.659374 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.659573 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.659688 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.659895 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.660017 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.660224 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.660334 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.660565 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.660660 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.660896 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.660995 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.661208 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.661325 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.661540 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.661852 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.661954 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.662166 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.662338 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.662483 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.662793 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.662891 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.663098 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.663404 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.663488 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.663716 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.664027 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.664113 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.664333 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.664635 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.664721 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.665013 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.665114 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.665276 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.665363 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.665585 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.665671 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.665893 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.665988 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.666200 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.666294 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.666510 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.666596 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.666816 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.666914 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.667121 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.667216 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.667575 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.667675 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.667764 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.667851 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.668029 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.668115 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.668333 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.668641 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.668734 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.668972 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.669258 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.669367 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.669573 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.669869 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.669964 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.670221 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.670467 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.670564 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.670841 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.671036 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.671141 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.671523 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.671616 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.671767 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.671868 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.672089 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.672184 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.672402 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.672540 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.672714 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.672879 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.673058 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.673188 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.673470 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.673553 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.673678 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.673909 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.674096 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.674228 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.674414 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.675094 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.675230 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.675429 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.675526 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.675763 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.675849 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.676071 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.676197 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.676379 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.676529 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.676833 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.676919 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.677022 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.677168 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.677335 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.677494 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.677647 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.677813 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.677959 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.678143 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.678270 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.678460 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.678776 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.678861 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.679135 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.679331 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.679428 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.679849 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.679979 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.680318 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.680411 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.680643 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.680904 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.681002 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.681330 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.681416 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.681645 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.681896 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.681985 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.682254 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.682380 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.682581 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.682866 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.682963 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.683194 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.683362 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.683507 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.683821 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.683914 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.684133 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.684372 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.684458 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.684743 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.684900 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.685078 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.685389 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.685474 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.685699 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.685885 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.686017 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.686329 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.686415 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.686639 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.686848 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.686956 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.687297 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.687390 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.687617 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.687800 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.687935 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.688256 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.688364 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.688573 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.688833 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.688925 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.689217 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.689312 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.689529 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.689794 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.689880 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.690172 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.690486 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.690573 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.690813 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.690987 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.691117 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.691492 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.691583 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.691832 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.691999 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.692153 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.692479 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.692579 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.692813 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.693011 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.693140 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.693468 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.693555 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.693783 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.693989 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.694090 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.694407 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.694493 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.694741 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.694965 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.695087 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.695421 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.695509 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.695750 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.696002 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.696089 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.696362 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.696510 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.696670 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.697006 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.697095 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.697328 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.697517 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.697642 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.697948 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.698034 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.698254 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.698452 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.698565 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.698871 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.698957 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.699179 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.699417 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.699512 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.699779 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.699905 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.700088 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.700383 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.700470 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.700689 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.700900 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.701019 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.701328 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.701425 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.701633 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.701832 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.701941 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.702252 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.702344 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.702558 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.702768 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.702858 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.703155 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.703242 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.703461 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.703707 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.703804 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.704089 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.704175 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.704424 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.704636 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.704743 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.705093 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.705182 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.705406 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.706125 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.706256 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.706579 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.706675 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.706905 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.707078 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.707233 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.707551 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.707646 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.707864 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.708025 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.708199 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.708505 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.708592 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.708839 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.709013 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.709154 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.709468 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.709555 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.709780 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.709959 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.710092 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.710421 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.710516 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.710752 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.710979 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.711079 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.711379 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.711474 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.711699 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.711970 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.712068 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.712325 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.712461 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.712649 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.712995 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.713084 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.713310 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.713499 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.713622 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.713931 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.714020 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.714241 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.714340 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.714554 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.714650 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.714872 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.714960 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.715191 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.715280 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.715518 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.715613 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.715845 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.715932 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.716158 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.716249 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.716495 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.716597 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.716826 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.716918 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.717144 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.717234 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.717476 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.717572 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.717814 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.717902 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.718146 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.718298 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.718466 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.718782 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.718868 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.719093 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.719278 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.719373 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 16:00:12.719773 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.720261 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.720743 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.721929 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.722428 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.722910 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.723403 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.723884 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.724372 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.724903 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.725456 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.725962 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.726305 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.726627 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.726963 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.727296 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.727652 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.728019 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.728369 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.728703 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.729053 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.729370 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.729714 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:00:12.730091 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 16:00:12.781423 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO dbcounter [None req-554f4db8-3e8b-4727-94bd-614aab10f3bf None None] Registered counter for database nova_api Jul 05 16:00:12.802874 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO dbcounter [None req-b29dbe27-985a-4003-8bea-ae4dc1b0c22e None None] Registered counter for database nova_api Jul 05 16:00:12.892622 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_db.sqlalchemy.engines [None req-554f4db8-3e8b-4727-94bd-614aab10f3bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103797) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 16:00:12.899809 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG dbcounter [-] [103797] Writer thread running {{(pid=103797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 16:00:12.914169 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_db.sqlalchemy.engines [None req-b29dbe27-985a-4003-8bea-ae4dc1b0c22e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103798) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 16:00:12.920437 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG dbcounter [-] [103798] Writer thread running {{(pid=103798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 16:00:12.955338 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.context [None req-554f4db8-3e8b-4727-94bd-614aab10f3bf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),095eb995-5888-495e-a6b9-faa45b31bc81(cell1) {{(pid=103797) load_cells /opt/stack/nova/nova/context.py:464}} Jul 05 16:00:12.959826 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_concurrency.lockutils [None req-554f4db8-3e8b-4727-94bd-614aab10f3bf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:00:12.961433 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_concurrency.lockutils [None req-554f4db8-3e8b-4727-94bd-614aab10f3bf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:00:12.962231 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_concurrency.lockutils [None req-554f4db8-3e8b-4727-94bd-614aab10f3bf None None] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:00:12.964318 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_concurrency.lockutils [None req-554f4db8-3e8b-4727-94bd-614aab10f3bf None None] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:00:12.966304 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO dbcounter [None req-554f4db8-3e8b-4727-94bd-614aab10f3bf None None] Registered counter for database nova_cell0 Jul 05 16:00:12.970147 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO dbcounter [None req-554f4db8-3e8b-4727-94bd-614aab10f3bf None None] Registered counter for database nova_cell1 Jul 05 16:00:12.975921 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.context [None req-b29dbe27-985a-4003-8bea-ae4dc1b0c22e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),095eb995-5888-495e-a6b9-faa45b31bc81(cell1) {{(pid=103798) load_cells /opt/stack/nova/nova/context.py:464}} Jul 05 16:00:12.978764 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_db.sqlalchemy.engines [None req-554f4db8-3e8b-4727-94bd-614aab10f3bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103797) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 16:00:12.979912 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-b29dbe27-985a-4003-8bea-ae4dc1b0c22e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:00:12.980371 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_db.sqlalchemy.engines [None req-554f4db8-3e8b-4727-94bd-614aab10f3bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103797) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 16:00:12.981776 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-b29dbe27-985a-4003-8bea-ae4dc1b0c22e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:00:12.982580 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-b29dbe27-985a-4003-8bea-ae4dc1b0c22e None None] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:00:12.984672 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-b29dbe27-985a-4003-8bea-ae4dc1b0c22e None None] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:00:12.986136 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG dbcounter [-] [103797] Writer thread running {{(pid=103797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 16:00:12.986687 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO dbcounter [None req-b29dbe27-985a-4003-8bea-ae4dc1b0c22e None None] Registered counter for database nova_cell0 Jul 05 16:00:12.990588 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO dbcounter [None req-b29dbe27-985a-4003-8bea-ae4dc1b0c22e None None] Registered counter for database nova_cell1 Jul 05 16:00:12.997784 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_db.sqlalchemy.engines [None req-b29dbe27-985a-4003-8bea-ae4dc1b0c22e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103798) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 16:00:12.999540 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_db.sqlalchemy.engines [None req-b29dbe27-985a-4003-8bea-ae4dc1b0c22e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103798) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 16:00:13.004966 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG dbcounter [-] [103798] Writer thread running {{(pid=103798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 16:00:13.009974 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG dbcounter [-] [103798] Writer thread running {{(pid=103798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 16:00:13.128092 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG dbcounter [-] [103797] Writer thread running {{(pid=103797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 16:00:13.138175 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO dbcounter [None req-554f4db8-3e8b-4727-94bd-614aab10f3bf None None] Registered counter for database nova_cell0 Jul 05 16:00:13.147389 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_db.sqlalchemy.engines [None req-554f4db8-3e8b-4727-94bd-614aab10f3bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103797) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 16:00:13.151653 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG dbcounter [-] [103797] Writer thread running {{(pid=103797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 16:00:13.171259 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO dbcounter [None req-b29dbe27-985a-4003-8bea-ae4dc1b0c22e None None] Registered counter for database nova_cell0 Jul 05 16:00:13.179821 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_db.sqlalchemy.engines [None req-b29dbe27-985a-4003-8bea-ae4dc1b0c22e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103798) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 16:00:13.184065 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG dbcounter [-] [103798] Writer thread running {{(pid=103798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 16:00:13.558465 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: WARNING keystonemiddleware.auth_token [None req-554f4db8-3e8b-4727-94bd-614aab10f3bf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 05 16:00:13.563677 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: WARNING keystonemiddleware.auth_token [None req-b29dbe27-985a-4003-8bea-ae4dc1b0c22e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 05 16:00:13.566354 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: WARNING keystonemiddleware.auth_token [None req-554f4db8-3e8b-4727-94bd-614aab10f3bf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 05 16:00:13.571603 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: WARNING keystonemiddleware.auth_token [None req-b29dbe27-985a-4003-8bea-ae4dc1b0c22e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 05 16:00:13.905365 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: WARNING keystonemiddleware.auth_token [None req-554f4db8-3e8b-4727-94bd-614aab10f3bf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 05 16:00:13.911712 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: WARNING keystonemiddleware.auth_token [None req-554f4db8-3e8b-4727-94bd-614aab10f3bf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 05 16:00:13.913981 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: WARNING keystonemiddleware.auth_token [None req-b29dbe27-985a-4003-8bea-ae4dc1b0c22e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 05 16:00:13.916950 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f6b78229c0 pid: 103797 (default app) Jul 05 16:00:13.918992 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-554f4db8-3e8b-4727-94bd-614aab10f3bf None None] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:00:13.919809 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: WARNING keystonemiddleware.auth_token [None req-b29dbe27-985a-4003-8bea-ae4dc1b0c22e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 05 16:00:13.920154 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-554f4db8-3e8b-4727-94bd-614aab10f3bf None None] 10.222.0.45 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001708 Jul 05 16:00:13.920568 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 788 bytes} [Tue Jul 5 16:00:13 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:00:13.925771 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f6b78229c0 pid: 103798 (default app) Jul 05 16:01:30.942482 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-554f4db8-3e8b-4727-94bd-614aab10f3bf None None] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:01:30.943489 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-554f4db8-3e8b-4727-94bd-614aab10f3bf None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 05 16:01:30.944063 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 2/2] 10.222.0.45 () {54 vars in 930 bytes} [Tue Jul 5 16:01:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:01:30.956961 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG dbcounter [-] [103798] Writing DB stats nova_api:SELECT=3 {{(pid=103798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:30.958087 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG dbcounter [-] [103798] Writing DB stats nova_cell1:SELECT=3 {{(pid=103798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:30.959073 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG dbcounter [-] [103798] Writing DB stats nova_cell0:SELECT=3 {{(pid=103798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:30.959810 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG dbcounter [-] [103798] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:31.405270 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-93e9098d-079f-4cb3-80bd-3b5fac87aeb0 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:01:31.438308 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-93e9098d-079f-4cb3-80bd-3b5fac87aeb0 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.487396 Jul 05 16:01:31.438914 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 1/3] 10.222.0.45 () {60 vars in 1291 bytes} [Tue Jul 5 16:01:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:01:33.487547 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-554f4db8-3e8b-4727-94bd-614aab10f3bf None None] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:01:33.488542 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-554f4db8-3e8b-4727-94bd-614aab10f3bf None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jul 05 16:01:33.489133 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 3/4] 10.222.0.45 () {54 vars in 930 bytes} [Tue Jul 5 16:01:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:01:33.549984 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-a94955c4-5115-442e-9039-a16529a41225 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "ram": 256, "vcpus": 1, "os-flavor-access:is_public": true, "name": "cirros256", "rxtx_factor": 1.0, "id": "c1"}} {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:01:33.568176 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 16:01:33.568176 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: warnings.warn(msg) Jul 05 16:01:33.672953 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-a94955c4-5115-442e-9039-a16529a41225 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.177584 Jul 05 16:01:33.673909 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 2/5] 10.222.0.45 () {64 vars in 1282 bytes} [Tue Jul 5 16:01:33 2022] POST /compute/v2.1/flavors => generated 407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 16:01:33.689078 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG dbcounter [-] [103797] Writing DB stats nova_api:SELECT=3 {{(pid=103797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:33.689963 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG dbcounter [-] [103797] Writing DB stats nova_cell1:SELECT=3 {{(pid=103797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:33.691246 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG dbcounter [-] [103797] Writing DB stats nova_cell0:SELECT=3 {{(pid=103797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:33.692065 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG dbcounter [-] [103797] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:01:33.903520 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-63b5a692-2d46-4fb0-a947-1bd594c14a18 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:01:33.906415 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 16:01:33.906415 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: warnings.warn(msg) Jul 05 16:01:34.003519 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-63b5a692-2d46-4fb0-a947-1bd594c14a18 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.320794 Jul 05 16:01:34.004271 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 4/6] 10.222.0.45 () {64 vars in 1335 bytes} [Tue Jul 5 16:01:33 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:01:36.128460 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-a94955c4-5115-442e-9039-a16529a41225 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:01:36.129589 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-a94955c4-5115-442e-9039-a16529a41225 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001585 Jul 05 16:01:36.130060 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 3/7] 10.222.0.45 () {54 vars in 930 bytes} [Tue Jul 5 16:01:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:01:36.238854 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-50802652-94d3-4523-b814-bb08df69c49e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "disk": 5, "vcpus": 1, "id": "d1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:01:36.257041 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 16:01:36.257041 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: warnings.warn(msg) Jul 05 16:01:36.320588 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-50802652-94d3-4523-b814-bb08df69c49e admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.184645 Jul 05 16:01:36.321166 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 5/8] 10.222.0.45 () {64 vars in 1282 bytes} [Tue Jul 5 16:01:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 16:01:36.333759 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-da08eab6-cee7-4bf1-88c8-5ca53b8de56d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:01:36.335343 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 16:01:36.335343 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: warnings.warn(msg) Jul 05 16:01:36.434504 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-da08eab6-cee7-4bf1-88c8-5ca53b8de56d admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104396 Jul 05 16:01:36.435093 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 4/9] 10.222.0.45 () {64 vars in 1335 bytes} [Tue Jul 5 16:01:36 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:01:38.539241 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-50802652-94d3-4523-b814-bb08df69c49e admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:01:38.540977 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-50802652-94d3-4523-b814-bb08df69c49e admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002038 Jul 05 16:01:38.541379 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 6/10] 10.222.0.45 () {54 vars in 930 bytes} [Tue Jul 5 16:01:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:01:38.599802 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-8c865e99-6b35-40ac-aa66-894cf3b5f38e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds1G", "swap": 0, "id": "d2", "ram": 1024, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:01:38.686197 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-8c865e99-6b35-40ac-aa66-894cf3b5f38e admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.138980 Jul 05 16:01:38.687482 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 5/11] 10.222.0.45 () {64 vars in 1282 bytes} [Tue Jul 5 16:01:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 16:01:38.699133 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-5e0a4660-5f18-49c2-b197-2fd13659d60c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:01:38.764244 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-5e0a4660-5f18-49c2-b197-2fd13659d60c admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.068755 Jul 05 16:01:38.765842 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 7/12] 10.222.0.45 () {64 vars in 1335 bytes} [Tue Jul 5 16:01:38 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:01:40.844293 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-8c865e99-6b35-40ac-aa66-894cf3b5f38e admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:01:40.845358 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-8c865e99-6b35-40ac-aa66-894cf3b5f38e admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Jul 05 16:01:40.845839 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 6/13] 10.222.0.45 () {54 vars in 930 bytes} [Tue Jul 5 16:01:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:01:40.906971 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-f2af1c25-c0a5-4e95-b095-1295525334c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "vcpus": 2, "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d3"}} {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:01:41.011232 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-f2af1c25-c0a5-4e95-b095-1295525334c4 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.158320 Jul 05 16:01:41.012011 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 8/14] 10.222.0.45 () {64 vars in 1282 bytes} [Tue Jul 5 16:01:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 16:01:41.024662 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-d22849a2-6b04-4b0d-9f04-8a3a6d6d5116 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:01:41.100231 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-d22849a2-6b04-4b0d-9f04-8a3a6d6d5116 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079350 Jul 05 16:01:41.100904 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 7/15] 10.222.0.45 () {64 vars in 1335 bytes} [Tue Jul 5 16:01:41 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:01:43.202641 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-f2af1c25-c0a5-4e95-b095-1295525334c4 admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:01:43.203658 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-f2af1c25-c0a5-4e95-b095-1295525334c4 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002040 Jul 05 16:01:43.204041 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 9/16] 10.222.0.45 () {54 vars in 930 bytes} [Tue Jul 5 16:01:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:01:43.267734 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-e176f88f-3f62-4c2e-bd36-b2ed228e4a73 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "os-flavor-access:is_public": true, "ram": 4096, "disk": 20, "rxtx_factor": 1.0, "id": "d4"}} {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:01:43.361978 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-e176f88f-3f62-4c2e-bd36-b2ed228e4a73 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.150821 Jul 05 16:01:43.362808 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 8/17] 10.222.0.45 () {64 vars in 1282 bytes} [Tue Jul 5 16:01:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 16:01:43.374952 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-e7191ddf-8492-4d3c-8a78-015a4199930a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:01:43.466737 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-e7191ddf-8492-4d3c-8a78-015a4199930a admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095919 Jul 05 16:01:43.467793 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 10/18] 10.222.0.45 () {64 vars in 1335 bytes} [Tue Jul 5 16:01:43 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:01:45.529506 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-e176f88f-3f62-4c2e-bd36-b2ed228e4a73 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:01:45.530555 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-e176f88f-3f62-4c2e-bd36-b2ed228e4a73 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Jul 05 16:01:45.530954 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 9/19] 10.222.0.45 () {54 vars in 930 bytes} [Tue Jul 5 16:01:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:01:45.591324 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-22d45363-4e3c-4708-ad27-1d86a89fde47 admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:01:45.613893 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-22d45363-4e3c-4708-ad27-1d86a89fde47 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077091 Jul 05 16:01:45.614424 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 11/20] 10.222.0.45 () {60 vars in 1291 bytes} [Tue Jul 5 16:01:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:01:47.777814 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-e176f88f-3f62-4c2e-bd36-b2ed228e4a73 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:01:47.778852 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-e176f88f-3f62-4c2e-bd36-b2ed228e4a73 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jul 05 16:01:47.779263 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 10/21] 10.222.0.45 () {54 vars in 930 bytes} [Tue Jul 5 16:01:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:01:47.840531 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-68bf2abc-d4d5-4948-907a-463cd896c449 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true, "name": "m1.tiny"}} {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:01:47.932019 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-68bf2abc-d4d5-4948-907a-463cd896c449 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.146156 Jul 05 16:01:47.932600 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 12/22] 10.222.0.45 () {64 vars in 1282 bytes} [Tue Jul 5 16:01:47 2022] POST /compute/v2.1/flavors => generated 402 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 16:01:47.944713 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-a5cd1874-afc4-4dd8-aae1-9e8094a4f8dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:01:48.026077 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-a5cd1874-afc4-4dd8-aae1-9e8094a4f8dc admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085111 Jul 05 16:01:48.026669 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 11/23] 10.222.0.45 () {64 vars in 1332 bytes} [Tue Jul 5 16:01:47 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:01:50.188376 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-68bf2abc-d4d5-4948-907a-463cd896c449 admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:01:50.189453 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-68bf2abc-d4d5-4948-907a-463cd896c449 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Jul 05 16:01:50.189869 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 13/24] 10.222.0.45 () {54 vars in 930 bytes} [Tue Jul 5 16:01:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:01:50.259158 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-ed5d3315-cc57-455f-a9fd-059d4c2a2f61 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "2", "name": "m1.small", "disk": 20}} {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:01:50.508716 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-ed5d3315-cc57-455f-a9fd-059d4c2a2f61 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.313094 Jul 05 16:01:50.509601 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 12/25] 10.222.0.45 () {64 vars in 1282 bytes} [Tue Jul 5 16:01:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 16:01:50.521511 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-7a462bfd-23b5-4657-870e-2b0780e0e159 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:01:50.620887 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-7a462bfd-23b5-4657-870e-2b0780e0e159 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103241 Jul 05 16:01:50.621476 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 14/26] 10.222.0.45 () {64 vars in 1332 bytes} [Tue Jul 5 16:01:50 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:01:52.716697 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-ed5d3315-cc57-455f-a9fd-059d4c2a2f61 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:01:52.717776 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-ed5d3315-cc57-455f-a9fd-059d4c2a2f61 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Jul 05 16:01:52.718179 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 13/27] 10.222.0.45 () {54 vars in 930 bytes} [Tue Jul 5 16:01:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:01:52.777564 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-91c6fd3c-289a-42f3-a496-8ea6a06fd462 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "rxtx_factor": 1.0, "disk": 40, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:01:52.870644 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-91c6fd3c-289a-42f3-a496-8ea6a06fd462 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.144982 Jul 05 16:01:52.871643 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 15/28] 10.222.0.45 () {64 vars in 1282 bytes} [Tue Jul 5 16:01:52 2022] POST /compute/v2.1/flavors => generated 406 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 05 16:01:52.884021 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-2910c46b-30f1-45b3-a26d-a61f33682164 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:01:52.963677 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-2910c46b-30f1-45b3-a26d-a61f33682164 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083661 Jul 05 16:01:52.964303 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 14/29] 10.222.0.45 () {64 vars in 1332 bytes} [Tue Jul 5 16:01:52 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:01:54.997020 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-91c6fd3c-289a-42f3-a496-8ea6a06fd462 admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:01:54.998023 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-91c6fd3c-289a-42f3-a496-8ea6a06fd462 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jul 05 16:01:54.998608 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 16/30] 10.222.0.45 () {54 vars in 930 bytes} [Tue Jul 5 16:01:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:01:55.057000 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-eebde2a8-2d4b-42fe-920d-93ecc9155577 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "4", "name": "m1.large", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:01:55.143127 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-eebde2a8-2d4b-42fe-920d-93ecc9155577 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.139026 Jul 05 16:01:55.143668 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 15/31] 10.222.0.45 () {64 vars in 1282 bytes} [Tue Jul 5 16:01:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 16:01:55.155515 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-5f640987-a999-4953-88b2-9c8b2e07096f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:01:55.225711 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-5f640987-a999-4953-88b2-9c8b2e07096f admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073802 Jul 05 16:01:55.226286 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 17/32] 10.222.0.45 () {64 vars in 1332 bytes} [Tue Jul 5 16:01:55 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:01:57.305758 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-eebde2a8-2d4b-42fe-920d-93ecc9155577 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:01:57.307442 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-eebde2a8-2d4b-42fe-920d-93ecc9155577 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002164 Jul 05 16:01:57.308016 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 16/33] 10.222.0.45 () {54 vars in 930 bytes} [Tue Jul 5 16:01:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:01:57.376607 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-23ac352f-a368-4985-8a53-20eb75057164 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "id": "5", "ram": 16384, "rxtx_factor": 1.0, "swap": 0, "name": "m1.xlarge", "disk": 160, "os-flavor-access:is_public": true}} {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:01:57.446592 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-23ac352f-a368-4985-8a53-20eb75057164 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.132036 Jul 05 16:01:57.447391 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 18/34] 10.222.0.45 () {64 vars in 1282 bytes} [Tue Jul 5 16:01:57 2022] POST /compute/v2.1/flavors => generated 408 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 16:01:57.459234 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-42d6dd7e-2d1f-4b10-8b10-4af550c9bfe7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:01:57.563400 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-42d6dd7e-2d1f-4b10-8b10-4af550c9bfe7 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107795 Jul 05 16:01:57.564267 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 17/35] 10.222.0.45 () {64 vars in 1332 bytes} [Tue Jul 5 16:01:57 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:02:22.699077 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-23ac352f-a368-4985-8a53-20eb75057164 admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:02:22.700069 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-23ac352f-a368-4985-8a53-20eb75057164 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jul 05 16:02:22.701038 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 19/36] 10.222.0.45 () {54 vars in 930 bytes} [Tue Jul 5 16:02:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:02:22.711220 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG dbcounter [-] [103798] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:02:22.758558 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-87e8d24c-ac44-4b0d-ba09-046890a8bd47 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:02:22.775417 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-87e8d24c-ac44-4b0d-ba09-046890a8bd47 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068700 Jul 05 16:02:22.775946 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 18/37] 10.222.0.45 () {60 vars in 1291 bytes} [Tue Jul 5 16:02:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:02:23.686203 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-23ac352f-a368-4985-8a53-20eb75057164 admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:02:23.687198 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-23ac352f-a368-4985-8a53-20eb75057164 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Jul 05 16:02:23.687591 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 20/38] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Jul 5 16:02:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:02:23.876749 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-fe55a875-353d-4a25-bff2-2958c30899af admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:02:23.882226 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.wsgi [None req-fe55a875-353d-4a25-bff2-2958c30899af admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 05 16:02:23.885503 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-fe55a875-353d-4a25-bff2-2958c30899af admin admin] Request method failure captured: Jul 05 16:02:23.885503 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 05 16:02:23.885503 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: Accept: application/json Jul 05 16:02:23.885503 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: Accept-Encoding: gzip, deflate Jul 05 16:02:23.885503 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: Connection: keep-alive Jul 05 16:02:23.885503 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: Content-Length: 0 Jul 05 16:02:23.885503 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: Host: 10.222.0.45 Jul 05 16:02:23.885503 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: Openstack-Api-Version: compute 2.90 Jul 05 16:02:23.885503 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: Openstack-System-Scope: None Jul 05 16:02:23.885503 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: User-Agent: python-novaclient Jul 05 16:02:23.885503 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Auth-Token: gAAAAABixGCPdIK2wDBSVxKvgOUx82FHm2HH8UqzWKOVv99GKq6poia3-lIKrhb2fzyeawpJnr963vkkExUSZ6H2EcHZMjQ-drxfW3km6-mY9rfmmMm0I2kZ7pP6pwouG_lVl4RBwDzZIJ5rgTb0xTYoXirR565fzns-nPGty4e2T8Exo2h-nf4 Jul 05 16:02:23.885503 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Domain-Id: None Jul 05 16:02:23.885503 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Domain-Name: None Jul 05 16:02:23.885503 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Identity-Status: Confirmed Jul 05 16:02:23.885503 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Is-Admin-Project: True Jul 05 16:02:23.885503 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Openstack-Nova-Api-Version: 2.90 Jul 05 16:02:23.885503 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Project-Domain-Id: default Jul 05 16:02:23.885503 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Project-Domain-Name: Default Jul 05 16:02:23.885503 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Project-Id: 35018c3fbb4f440c9fd930631a71e6c6 Jul 05 16:02:23.885503 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Project-Name: admin Jul 05 16:02:23.885503 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Role: member,reader,admin Jul 05 16:02:23.885503 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Roles: member,reader,admin Jul 05 16:02:23.887188 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_35018c3fbb4f440c9fd930631a71e6c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/35018c3fbb4f440c9fd930631a71e6c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/35018c3fbb4f440c9fd930631a71e6c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/35018c3fbb4f440c9fd930631a71e6c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:02:23.887188 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Tenant: admin Jul 05 16:02:23.887188 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Tenant-Id: 35018c3fbb4f440c9fd930631a71e6c6 Jul 05 16:02:23.887188 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Tenant-Name: admin Jul 05 16:02:23.887188 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-User: admin Jul 05 16:02:23.887188 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-User-Domain-Id: default Jul 05 16:02:23.887188 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-User-Domain-Name: Default Jul 05 16:02:23.887188 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-User-Id: 45ceaef67f814339b45f2d297054bedf Jul 05 16:02:23.887188 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-User-Name: admin Jul 05 16:02:23.887188 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: method: > Jul 05 16:02:23.887188 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: exception: Flavor 42 could not be found. Jul 05 16:02:23.887188 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: action_args: {'id': '42'} Jul 05 16:02:23.887188 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:02:23.887188 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:02:23.888840 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 05 16:02:23.888840 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 05 16:02:23.888840 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 05 16:02:23.888840 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 05 16:02:23.888840 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 05 16:02:23.888840 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 05 16:02:23.888840 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 05 16:02:23.888840 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 05 16:02:23.888840 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 05 16:02:23.888840 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:02:23.888840 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 05 16:02:23.888840 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 05 16:02:23.888840 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 05 16:02:23.888840 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Jul 05 16:02:23.888840 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:02:23.888840 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Jul 05 16:02:23.888840 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:02:23.888840 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:02:23.888840 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:02:23.890259 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:02:23.890259 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:02:23.890259 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:02:23.890259 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:02:23.890259 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 05 16:02:23.890259 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:02:23.890259 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 05 16:02:23.890259 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Jul 05 16:02:23.890259 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:02:23.890259 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Jul 05 16:02:23.890259 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:02:23.890259 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:02:23.890259 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:02:23.890259 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:02:23.890259 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:02:23.890259 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 05 16:02:23.890259 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Jul 05 16:02:23.890259 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-fe55a875-353d-4a25-bff2-2958c30899af admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:02:23.891527 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-fe55a875-353d-4a25-bff2-2958c30899af admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063164 Jul 05 16:02:23.891527 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 19/39] 10.222.0.45 () {60 vars in 1190 bytes} [Tue Jul 5 16:02:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 05 16:02:23.897039 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-fdb7adf6-af3f-4068-99a7-ca70b282d798 admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:02:23.899909 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG dbcounter [-] [103797] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:02:23.917891 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-fdb7adf6-af3f-4068-99a7-ca70b282d798 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024428 Jul 05 16:02:23.918401 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 21/40] 10.222.0.45 () {60 vars in 1210 bytes} [Tue Jul 5 16:02:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:02:23.927758 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-c730b8c9-52a9-4e33-b2c7-f116b26e4f68 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:02:23.949040 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-c730b8c9-52a9-4e33-b2c7-f116b26e4f68 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024796 Jul 05 16:02:23.949554 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 20/41] 10.222.0.45 () {60 vars in 1210 bytes} [Tue Jul 5 16:02:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:02:23.959291 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-ad9e03f9-f627-48a0-b7ee-2ab46853f52e admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:02:23.965588 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.wsgi [None req-ad9e03f9-f627-48a0-b7ee-2ab46853f52e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 05 16:02:23.968828 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-ad9e03f9-f627-48a0-b7ee-2ab46853f52e admin admin] Request method failure captured: Jul 05 16:02:23.968828 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 05 16:02:23.968828 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: Accept: application/json Jul 05 16:02:23.968828 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: Accept-Encoding: gzip, deflate Jul 05 16:02:23.968828 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: Connection: keep-alive Jul 05 16:02:23.968828 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: Content-Length: 0 Jul 05 16:02:23.968828 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: Host: 10.222.0.45 Jul 05 16:02:23.968828 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: Openstack-Api-Version: compute 2.90 Jul 05 16:02:23.968828 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: Openstack-System-Scope: None Jul 05 16:02:23.968828 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: User-Agent: python-novaclient Jul 05 16:02:23.968828 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Auth-Token: gAAAAABixGCPdIK2wDBSVxKvgOUx82FHm2HH8UqzWKOVv99GKq6poia3-lIKrhb2fzyeawpJnr963vkkExUSZ6H2EcHZMjQ-drxfW3km6-mY9rfmmMm0I2kZ7pP6pwouG_lVl4RBwDzZIJ5rgTb0xTYoXirR565fzns-nPGty4e2T8Exo2h-nf4 Jul 05 16:02:23.968828 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Domain-Id: None Jul 05 16:02:23.968828 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Domain-Name: None Jul 05 16:02:23.968828 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Identity-Status: Confirmed Jul 05 16:02:23.968828 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Is-Admin-Project: True Jul 05 16:02:23.968828 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Openstack-Nova-Api-Version: 2.90 Jul 05 16:02:23.968828 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Project-Domain-Id: default Jul 05 16:02:23.968828 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Project-Domain-Name: Default Jul 05 16:02:23.968828 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Project-Id: 35018c3fbb4f440c9fd930631a71e6c6 Jul 05 16:02:23.968828 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Project-Name: admin Jul 05 16:02:23.968828 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Role: member,reader,admin Jul 05 16:02:23.968828 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Roles: member,reader,admin Jul 05 16:02:23.970503 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_35018c3fbb4f440c9fd930631a71e6c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/35018c3fbb4f440c9fd930631a71e6c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/35018c3fbb4f440c9fd930631a71e6c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/35018c3fbb4f440c9fd930631a71e6c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:02:23.970503 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Tenant: admin Jul 05 16:02:23.970503 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Tenant-Id: 35018c3fbb4f440c9fd930631a71e6c6 Jul 05 16:02:23.970503 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Tenant-Name: admin Jul 05 16:02:23.970503 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-User: admin Jul 05 16:02:23.970503 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-User-Domain-Id: default Jul 05 16:02:23.970503 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-User-Domain-Name: Default Jul 05 16:02:23.970503 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-User-Id: 45ceaef67f814339b45f2d297054bedf Jul 05 16:02:23.970503 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-User-Name: admin Jul 05 16:02:23.970503 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: method: > Jul 05 16:02:23.970503 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: exception: Flavor 42 could not be found. Jul 05 16:02:23.970503 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: action_args: {'id': '42'} Jul 05 16:02:23.970503 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:02:23.970503 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:02:23.971468 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 05 16:02:23.971468 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 05 16:02:23.971468 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 05 16:02:23.971468 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 05 16:02:23.971468 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 05 16:02:23.971468 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 05 16:02:23.971468 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 05 16:02:23.971468 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 05 16:02:23.971468 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 05 16:02:23.971468 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:02:23.971468 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 05 16:02:23.971468 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 05 16:02:23.971468 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 05 16:02:23.971468 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Jul 05 16:02:23.971468 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:02:23.971468 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Jul 05 16:02:23.971468 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:02:23.971468 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:02:23.971468 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:02:23.972794 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:02:23.972794 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:02:23.972794 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:02:23.972794 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:02:23.972794 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 05 16:02:23.972794 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:02:23.972794 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 05 16:02:23.972794 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Jul 05 16:02:23.972794 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:02:23.972794 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Jul 05 16:02:23.972794 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:02:23.972794 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:02:23.972794 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:02:23.972794 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:02:23.972794 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:02:23.972794 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 05 16:02:23.972794 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Jul 05 16:02:23.972794 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-ad9e03f9-f627-48a0-b7ee-2ab46853f52e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:02:23.974279 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-ad9e03f9-f627-48a0-b7ee-2ab46853f52e admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014527 Jul 05 16:02:23.974279 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 22/42] 10.222.0.45 () {60 vars in 1190 bytes} [Tue Jul 5 16:02:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 05 16:02:24.787171 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-c730b8c9-52a9-4e33-b2c7-f116b26e4f68 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:02:24.788278 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-c730b8c9-52a9-4e33-b2c7-f116b26e4f68 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Jul 05 16:02:24.788665 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 21/43] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Jul 5 16:02:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:02:24.973543 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-ea737516-8e03-4136-80dd-26e4df8ec3b9 admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:02:24.979737 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.wsgi [None req-ea737516-8e03-4136-80dd-26e4df8ec3b9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 05 16:02:24.981796 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-ea737516-8e03-4136-80dd-26e4df8ec3b9 admin admin] Request method failure captured: Jul 05 16:02:24.981796 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 05 16:02:24.981796 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: Accept: application/json Jul 05 16:02:24.981796 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: Accept-Encoding: gzip, deflate Jul 05 16:02:24.981796 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: Connection: keep-alive Jul 05 16:02:24.981796 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: Content-Length: 0 Jul 05 16:02:24.981796 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: Host: 10.222.0.45 Jul 05 16:02:24.981796 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: Openstack-Api-Version: compute 2.90 Jul 05 16:02:24.981796 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: Openstack-System-Scope: None Jul 05 16:02:24.981796 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: User-Agent: python-novaclient Jul 05 16:02:24.981796 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Auth-Token: gAAAAABixGCQsuSBvyZXfSiTOIdtAOrbOWTmBxDRagBBpv20Thn7q3a1bNx2ubF1NfSbyOZF9qEHyA4Nw7VNMg_tTiZ4a7xGKEZ8UoJSWsOSereVYLTdFKaEhyoHJ2NoDvHFyWy6-V7AiCpas4XqWHWW2gFAU0oOHsxq0AKQw_uqS5VQRKRbyeU Jul 05 16:02:24.981796 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Domain-Id: None Jul 05 16:02:24.981796 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Domain-Name: None Jul 05 16:02:24.981796 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Identity-Status: Confirmed Jul 05 16:02:24.981796 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Is-Admin-Project: True Jul 05 16:02:24.981796 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Openstack-Nova-Api-Version: 2.90 Jul 05 16:02:24.981796 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Project-Domain-Id: default Jul 05 16:02:24.981796 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Project-Domain-Name: Default Jul 05 16:02:24.981796 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Project-Id: 35018c3fbb4f440c9fd930631a71e6c6 Jul 05 16:02:24.981796 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Project-Name: admin Jul 05 16:02:24.981796 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Role: member,reader,admin Jul 05 16:02:24.981796 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Roles: member,reader,admin Jul 05 16:02:24.983472 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_35018c3fbb4f440c9fd930631a71e6c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/35018c3fbb4f440c9fd930631a71e6c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/35018c3fbb4f440c9fd930631a71e6c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/35018c3fbb4f440c9fd930631a71e6c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:02:24.983472 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Tenant: admin Jul 05 16:02:24.983472 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Tenant-Id: 35018c3fbb4f440c9fd930631a71e6c6 Jul 05 16:02:24.983472 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Tenant-Name: admin Jul 05 16:02:24.983472 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-User: admin Jul 05 16:02:24.983472 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-User-Domain-Id: default Jul 05 16:02:24.983472 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-User-Domain-Name: Default Jul 05 16:02:24.983472 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-User-Id: 45ceaef67f814339b45f2d297054bedf Jul 05 16:02:24.983472 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-User-Name: admin Jul 05 16:02:24.983472 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: method: > Jul 05 16:02:24.983472 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: exception: Flavor 84 could not be found. Jul 05 16:02:24.983472 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: action_args: {'id': '84'} Jul 05 16:02:24.983472 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:02:24.983472 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:02:24.984982 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 05 16:02:24.984982 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 05 16:02:24.984982 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 05 16:02:24.984982 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 05 16:02:24.984982 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 05 16:02:24.984982 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 05 16:02:24.984982 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 05 16:02:24.984982 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 05 16:02:24.984982 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 05 16:02:24.984982 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:02:24.984982 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 05 16:02:24.984982 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 05 16:02:24.984982 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 05 16:02:24.984982 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Jul 05 16:02:24.984982 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:02:24.984982 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Jul 05 16:02:24.984982 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:02:24.984982 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:02:24.984982 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:02:24.987466 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:02:24.987466 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:02:24.987466 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:02:24.987466 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:02:24.987466 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 05 16:02:24.987466 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:02:24.987466 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 05 16:02:24.987466 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Jul 05 16:02:24.987466 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:02:24.987466 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Jul 05 16:02:24.987466 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:02:24.987466 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:02:24.987466 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:02:24.987466 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:02:24.987466 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:02:24.987466 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 05 16:02:24.987466 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Jul 05 16:02:24.987466 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-ea737516-8e03-4136-80dd-26e4df8ec3b9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:02:24.989246 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-ea737516-8e03-4136-80dd-26e4df8ec3b9 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060613 Jul 05 16:02:24.989246 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 23/44] 10.222.0.45 () {60 vars in 1190 bytes} [Tue Jul 5 16:02:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 05 16:02:24.996751 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-096aef0a-7c60-430c-96d1-2e504b84aed1 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:02:25.011012 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-096aef0a-7c60-430c-96d1-2e504b84aed1 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018083 Jul 05 16:02:25.011480 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 22/45] 10.222.0.45 () {60 vars in 1210 bytes} [Tue Jul 5 16:02:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:02:25.020914 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-688e46ce-bea4-4155-8157-eb43e782fbe5 admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:02:25.034394 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-688e46ce-bea4-4155-8157-eb43e782fbe5 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016959 Jul 05 16:02:25.034894 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 24/46] 10.222.0.45 () {60 vars in 1210 bytes} [Tue Jul 5 16:02:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:02:25.043710 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-f2a0054e-156e-4173-aa00-44987ca3466f admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:02:25.049480 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.wsgi [None req-f2a0054e-156e-4173-aa00-44987ca3466f admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 05 16:02:25.050950 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-f2a0054e-156e-4173-aa00-44987ca3466f admin admin] Request method failure captured: Jul 05 16:02:25.050950 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 05 16:02:25.050950 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: Accept: application/json Jul 05 16:02:25.050950 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: Accept-Encoding: gzip, deflate Jul 05 16:02:25.050950 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: Connection: keep-alive Jul 05 16:02:25.050950 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: Content-Length: 0 Jul 05 16:02:25.050950 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: Host: 10.222.0.45 Jul 05 16:02:25.050950 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: Openstack-Api-Version: compute 2.90 Jul 05 16:02:25.050950 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: Openstack-System-Scope: None Jul 05 16:02:25.050950 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: User-Agent: python-novaclient Jul 05 16:02:25.050950 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Auth-Token: gAAAAABixGCQsuSBvyZXfSiTOIdtAOrbOWTmBxDRagBBpv20Thn7q3a1bNx2ubF1NfSbyOZF9qEHyA4Nw7VNMg_tTiZ4a7xGKEZ8UoJSWsOSereVYLTdFKaEhyoHJ2NoDvHFyWy6-V7AiCpas4XqWHWW2gFAU0oOHsxq0AKQw_uqS5VQRKRbyeU Jul 05 16:02:25.050950 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Domain-Id: None Jul 05 16:02:25.050950 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Domain-Name: None Jul 05 16:02:25.050950 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Identity-Status: Confirmed Jul 05 16:02:25.050950 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Is-Admin-Project: True Jul 05 16:02:25.050950 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Openstack-Nova-Api-Version: 2.90 Jul 05 16:02:25.050950 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Project-Domain-Id: default Jul 05 16:02:25.050950 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Project-Domain-Name: Default Jul 05 16:02:25.050950 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Project-Id: 35018c3fbb4f440c9fd930631a71e6c6 Jul 05 16:02:25.050950 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Project-Name: admin Jul 05 16:02:25.050950 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Role: member,reader,admin Jul 05 16:02:25.050950 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Roles: member,reader,admin Jul 05 16:02:25.052536 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_35018c3fbb4f440c9fd930631a71e6c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/35018c3fbb4f440c9fd930631a71e6c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/35018c3fbb4f440c9fd930631a71e6c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/35018c3fbb4f440c9fd930631a71e6c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:02:25.052536 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Tenant: admin Jul 05 16:02:25.052536 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Tenant-Id: 35018c3fbb4f440c9fd930631a71e6c6 Jul 05 16:02:25.052536 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Tenant-Name: admin Jul 05 16:02:25.052536 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-User: admin Jul 05 16:02:25.052536 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-User-Domain-Id: default Jul 05 16:02:25.052536 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-User-Domain-Name: Default Jul 05 16:02:25.052536 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-User-Id: 45ceaef67f814339b45f2d297054bedf Jul 05 16:02:25.052536 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-User-Name: admin Jul 05 16:02:25.052536 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: method: > Jul 05 16:02:25.052536 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: exception: Flavor 84 could not be found. Jul 05 16:02:25.052536 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: action_args: {'id': '84'} Jul 05 16:02:25.052536 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:02:25.052536 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:02:25.053542 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 05 16:02:25.053542 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 05 16:02:25.053542 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 05 16:02:25.053542 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 05 16:02:25.053542 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 05 16:02:25.053542 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 05 16:02:25.053542 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 05 16:02:25.053542 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 05 16:02:25.053542 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 05 16:02:25.053542 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:02:25.053542 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 05 16:02:25.053542 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 05 16:02:25.053542 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 05 16:02:25.053542 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Jul 05 16:02:25.053542 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:02:25.053542 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Jul 05 16:02:25.053542 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:02:25.053542 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:02:25.053542 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:02:25.054612 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:02:25.054612 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:02:25.054612 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:02:25.054612 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:02:25.054612 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 05 16:02:25.054612 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:02:25.054612 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 05 16:02:25.054612 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Jul 05 16:02:25.054612 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:02:25.054612 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Jul 05 16:02:25.054612 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:02:25.054612 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:02:25.054612 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:02:25.054612 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:02:25.054612 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:02:25.054612 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 05 16:02:25.054612 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Jul 05 16:02:25.054612 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-f2a0054e-156e-4173-aa00-44987ca3466f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:02:25.055610 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-f2a0054e-156e-4173-aa00-44987ca3466f admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012036 Jul 05 16:02:25.055610 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 23/47] 10.222.0.45 () {60 vars in 1190 bytes} [Tue Jul 5 16:02:25 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 05 16:02:25.867250 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-688e46ce-bea4-4155-8157-eb43e782fbe5 admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:02:25.868263 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-688e46ce-bea4-4155-8157-eb43e782fbe5 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jul 05 16:02:25.868656 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 25/48] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Jul 5 16:02:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:02:26.055456 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-7e47efa4-565c-46c3-b93e-434c4d2fbfe3 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:02:26.061366 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.wsgi [None req-7e47efa4-565c-46c3-b93e-434c4d2fbfe3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 05 16:02:26.062837 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-7e47efa4-565c-46c3-b93e-434c4d2fbfe3 admin admin] Request method failure captured: Jul 05 16:02:26.062837 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 05 16:02:26.062837 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: Accept: application/json Jul 05 16:02:26.062837 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: Accept-Encoding: gzip, deflate Jul 05 16:02:26.062837 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: Connection: keep-alive Jul 05 16:02:26.062837 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: Content-Length: 0 Jul 05 16:02:26.062837 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: Host: 10.222.0.45 Jul 05 16:02:26.062837 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: Openstack-Api-Version: compute 2.90 Jul 05 16:02:26.062837 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: Openstack-System-Scope: None Jul 05 16:02:26.062837 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: User-Agent: python-novaclient Jul 05 16:02:26.062837 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Auth-Token: gAAAAABixGCRrH1qAgmynOe60Ivjy-eZ419Knc_Y_0B2mNg9uY0oGri3yddT5mGZDWJXOXGFyniWvo6Yr88zncdNZqI03hIw32AfXs3-sgST-LDyo4JTfst_qeuOe0PbX9nVb0byLMKd6ox3ugwmEEBO8detCAvq0XylzLxAEVYZkBQ8ld11btw Jul 05 16:02:26.062837 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Domain-Id: None Jul 05 16:02:26.062837 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Domain-Name: None Jul 05 16:02:26.062837 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Identity-Status: Confirmed Jul 05 16:02:26.062837 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Is-Admin-Project: True Jul 05 16:02:26.062837 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Openstack-Nova-Api-Version: 2.90 Jul 05 16:02:26.062837 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Project-Domain-Id: default Jul 05 16:02:26.062837 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Project-Domain-Name: Default Jul 05 16:02:26.062837 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Project-Id: 35018c3fbb4f440c9fd930631a71e6c6 Jul 05 16:02:26.062837 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Project-Name: admin Jul 05 16:02:26.062837 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Role: member,reader,admin Jul 05 16:02:26.062837 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Roles: member,reader,admin Jul 05 16:02:26.064369 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_35018c3fbb4f440c9fd930631a71e6c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/35018c3fbb4f440c9fd930631a71e6c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/35018c3fbb4f440c9fd930631a71e6c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/35018c3fbb4f440c9fd930631a71e6c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:02:26.064369 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Tenant: admin Jul 05 16:02:26.064369 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Tenant-Id: 35018c3fbb4f440c9fd930631a71e6c6 Jul 05 16:02:26.064369 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-Tenant-Name: admin Jul 05 16:02:26.064369 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-User: admin Jul 05 16:02:26.064369 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-User-Domain-Id: default Jul 05 16:02:26.064369 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-User-Domain-Name: Default Jul 05 16:02:26.064369 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-User-Id: 45ceaef67f814339b45f2d297054bedf Jul 05 16:02:26.064369 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: X-User-Name: admin Jul 05 16:02:26.064369 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: method: > Jul 05 16:02:26.064369 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: exception: Flavor 451 could not be found. Jul 05 16:02:26.064369 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: action_args: {'id': '451'} Jul 05 16:02:26.064369 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:02:26.064369 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:02:26.065420 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 05 16:02:26.065420 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 05 16:02:26.065420 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 05 16:02:26.065420 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 05 16:02:26.065420 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 05 16:02:26.065420 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 05 16:02:26.065420 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 05 16:02:26.065420 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 05 16:02:26.065420 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 05 16:02:26.065420 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:02:26.065420 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 05 16:02:26.065420 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 05 16:02:26.065420 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 05 16:02:26.065420 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Jul 05 16:02:26.065420 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:02:26.065420 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Jul 05 16:02:26.065420 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:02:26.065420 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:02:26.065420 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:02:26.066825 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:02:26.066825 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:02:26.066825 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:02:26.066825 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:02:26.066825 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 05 16:02:26.066825 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:02:26.066825 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 05 16:02:26.066825 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Jul 05 16:02:26.066825 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:02:26.066825 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Jul 05 16:02:26.066825 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:02:26.066825 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:02:26.066825 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:02:26.066825 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:02:26.066825 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:02:26.066825 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 05 16:02:26.066825 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Jul 05 16:02:26.066825 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-7e47efa4-565c-46c3-b93e-434c4d2fbfe3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:02:26.068142 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-7e47efa4-565c-46c3-b93e-434c4d2fbfe3 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058727 Jul 05 16:02:26.068142 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 24/49] 10.222.0.45 () {60 vars in 1193 bytes} [Tue Jul 5 16:02:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 05 16:02:26.073823 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-93900103-3f7f-4eb1-91ff-5c77fe73b988 admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:02:26.087712 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-93900103-3f7f-4eb1-91ff-5c77fe73b988 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017485 Jul 05 16:02:26.088228 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 26/50] 10.222.0.45 () {60 vars in 1210 bytes} [Tue Jul 5 16:02:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:02:26.097807 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-5a4635a3-89e2-4792-90ea-4460fca594e3 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:02:26.111041 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-5a4635a3-89e2-4792-90ea-4460fca594e3 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017080 Jul 05 16:02:26.111554 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 25/51] 10.222.0.45 () {60 vars in 1210 bytes} [Tue Jul 5 16:02:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:02:26.120231 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-4e87722f-66f5-4b20-9b42-a6ec977660a6 admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:02:26.125905 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.wsgi [None req-4e87722f-66f5-4b20-9b42-a6ec977660a6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 05 16:02:26.127359 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-4e87722f-66f5-4b20-9b42-a6ec977660a6 admin admin] Request method failure captured: Jul 05 16:02:26.127359 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 05 16:02:26.127359 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: Accept: application/json Jul 05 16:02:26.127359 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: Accept-Encoding: gzip, deflate Jul 05 16:02:26.127359 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: Connection: keep-alive Jul 05 16:02:26.127359 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: Content-Length: 0 Jul 05 16:02:26.127359 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: Host: 10.222.0.45 Jul 05 16:02:26.127359 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: Openstack-Api-Version: compute 2.90 Jul 05 16:02:26.127359 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: Openstack-System-Scope: None Jul 05 16:02:26.127359 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: User-Agent: python-novaclient Jul 05 16:02:26.127359 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Auth-Token: gAAAAABixGCRrH1qAgmynOe60Ivjy-eZ419Knc_Y_0B2mNg9uY0oGri3yddT5mGZDWJXOXGFyniWvo6Yr88zncdNZqI03hIw32AfXs3-sgST-LDyo4JTfst_qeuOe0PbX9nVb0byLMKd6ox3ugwmEEBO8detCAvq0XylzLxAEVYZkBQ8ld11btw Jul 05 16:02:26.127359 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Domain-Id: None Jul 05 16:02:26.127359 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Domain-Name: None Jul 05 16:02:26.127359 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Identity-Status: Confirmed Jul 05 16:02:26.127359 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Is-Admin-Project: True Jul 05 16:02:26.127359 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Openstack-Nova-Api-Version: 2.90 Jul 05 16:02:26.127359 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Project-Domain-Id: default Jul 05 16:02:26.127359 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Project-Domain-Name: Default Jul 05 16:02:26.127359 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Project-Id: 35018c3fbb4f440c9fd930631a71e6c6 Jul 05 16:02:26.127359 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Project-Name: admin Jul 05 16:02:26.127359 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Role: member,reader,admin Jul 05 16:02:26.127359 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Roles: member,reader,admin Jul 05 16:02:26.128913 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_35018c3fbb4f440c9fd930631a71e6c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/35018c3fbb4f440c9fd930631a71e6c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/35018c3fbb4f440c9fd930631a71e6c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/35018c3fbb4f440c9fd930631a71e6c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:02:26.128913 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Tenant: admin Jul 05 16:02:26.128913 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Tenant-Id: 35018c3fbb4f440c9fd930631a71e6c6 Jul 05 16:02:26.128913 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-Tenant-Name: admin Jul 05 16:02:26.128913 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-User: admin Jul 05 16:02:26.128913 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-User-Domain-Id: default Jul 05 16:02:26.128913 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-User-Domain-Name: Default Jul 05 16:02:26.128913 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-User-Id: 45ceaef67f814339b45f2d297054bedf Jul 05 16:02:26.128913 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: X-User-Name: admin Jul 05 16:02:26.128913 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: method: > Jul 05 16:02:26.128913 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: exception: Flavor 451 could not be found. Jul 05 16:02:26.128913 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: action_args: {'id': '451'} Jul 05 16:02:26.128913 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:02:26.128913 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:02:26.130039 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 05 16:02:26.130039 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 05 16:02:26.130039 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 05 16:02:26.130039 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 05 16:02:26.130039 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 05 16:02:26.130039 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 05 16:02:26.130039 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 05 16:02:26.130039 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 05 16:02:26.130039 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 05 16:02:26.130039 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:02:26.130039 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 05 16:02:26.130039 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 05 16:02:26.130039 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 05 16:02:26.130039 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Jul 05 16:02:26.130039 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:02:26.130039 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Jul 05 16:02:26.130039 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:02:26.130039 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:02:26.130039 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:02:26.131195 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:02:26.131195 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:02:26.131195 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:02:26.131195 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:02:26.131195 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 05 16:02:26.131195 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:02:26.131195 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 05 16:02:26.131195 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Jul 05 16:02:26.131195 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:02:26.131195 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Jul 05 16:02:26.131195 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:02:26.131195 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:02:26.131195 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:02:26.131195 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:02:26.131195 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:02:26.131195 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 05 16:02:26.131195 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Jul 05 16:02:26.131195 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-4e87722f-66f5-4b20-9b42-a6ec977660a6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:02:26.132209 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-4e87722f-66f5-4b20-9b42-a6ec977660a6 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011826 Jul 05 16:02:26.132209 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 27/52] 10.222.0.45 () {60 vars in 1193 bytes} [Tue Jul 5 16:02:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 05 16:02:26.942652 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-5a4635a3-89e2-4792-90ea-4460fca594e3 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:02:26.943816 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-5a4635a3-89e2-4792-90ea-4460fca594e3 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 Jul 05 16:02:26.944210 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 26/53] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Jul 5 16:02:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:02:27.138284 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-8dfc61b3-73d5-4d9d-9955-d9b1d0debddb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:02:27.267537 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-8dfc61b3-73d5-4d9d-9955-d9b1d0debddb admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.181180 Jul 05 16:02:27.272179 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 28/54] 10.222.0.45 () {64 vars in 1235 bytes} [Tue Jul 5 16:02:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 16:02:28.079148 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-5a4635a3-89e2-4792-90ea-4460fca594e3 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:02:28.080156 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-5a4635a3-89e2-4792-90ea-4460fca594e3 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jul 05 16:02:28.080552 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 27/55] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Jul 5 16:02:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:02:28.270198 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-0d917720-3763-4d35-a2c5-bf5c79edb149 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:02:28.381784 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-0d917720-3763-4d35-a2c5-bf5c79edb149 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.162992 Jul 05 16:02:28.382325 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 29/56] 10.222.0.45 () {64 vars in 1235 bytes} [Tue Jul 5 16:02:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 16:02:29.199003 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-5a4635a3-89e2-4792-90ea-4460fca594e3 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:02:29.200500 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-5a4635a3-89e2-4792-90ea-4460fca594e3 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 Jul 05 16:02:29.200950 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 28/57] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Jul 5 16:02:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:02:29.388134 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-7571b636-0c19-4cde-b8aa-b8060e6a7ee4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:02:29.506643 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-7571b636-0c19-4cde-b8aa-b8060e6a7ee4 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.170402 Jul 05 16:02:29.507087 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 30/58] 10.222.0.45 () {64 vars in 1235 bytes} [Tue Jul 5 16:02:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 16:02:30.321396 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-5a4635a3-89e2-4792-90ea-4460fca594e3 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:02:30.322403 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-5a4635a3-89e2-4792-90ea-4460fca594e3 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 05 16:02:30.322799 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 29/59] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Jul 5 16:02:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:02:30.510061 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-81a2484e-061d-44fd-bd13-a9c07cc9233d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:02:30.581154 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-81a2484e-061d-44fd-bd13-a9c07cc9233d admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.122399 Jul 05 16:02:30.581651 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 31/60] 10.222.0.45 () {64 vars in 1235 bytes} [Tue Jul 5 16:02:30 2022] POST /compute/v2.1/flavors => generated 409 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 05 16:02:31.401040 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-5a4635a3-89e2-4792-90ea-4460fca594e3 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:02:31.402063 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-5a4635a3-89e2-4792-90ea-4460fca594e3 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001567 Jul 05 16:02:31.402489 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 30/61] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Jul 5 16:02:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:02:31.594960 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-d587f508-fc23-4d57-8bf3-8607e9707313 admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:02:31.613757 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-d587f508-fc23-4d57-8bf3-8607e9707313 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070229 Jul 05 16:02:31.614283 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 32/62] 10.222.0.45 () {60 vars in 1202 bytes} [Tue Jul 5 16:02:31 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:03:18.145116 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-5a4635a3-89e2-4792-90ea-4460fca594e3 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:03:18.146107 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-5a4635a3-89e2-4792-90ea-4460fca594e3 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jul 05 16:03:18.146495 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 31/63] 10.222.0.45 () {54 vars in 930 bytes} [Tue Jul 5 16:03:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:03:18.157230 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG dbcounter [-] [103797] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:18.203693 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-9849efe3-1db4-4673-92e9-22ecb0750f84 admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:03:18.223458 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-9849efe3-1db4-4673-92e9-22ecb0750f84 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070609 Jul 05 16:03:18.224048 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 33/64] 10.222.0.45 () {60 vars in 1291 bytes} [Tue Jul 5 16:03:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:03:18.247366 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-72a6a548-cb6d-48d8-899b-ef0c02dd51b4 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:03:18.250700 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG dbcounter [-] [103798] Writing DB stats nova_api:SELECT=14 {{(pid=103798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:03:18.255573 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-72a6a548-cb6d-48d8-899b-ef0c02dd51b4 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012008 Jul 05 16:03:18.256087 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 32/65] 10.222.0.45 () {60 vars in 1282 bytes} [Tue Jul 5 16:03:18 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:03:18.267889 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-78976d6a-f155-4ae4-9241-e0bdceb2ab5a admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:03:18.276200 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-78976d6a-f155-4ae4-9241-e0bdceb2ab5a admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011816 Jul 05 16:03:18.277377 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 34/66] 10.222.0.45 () {60 vars in 1285 bytes} [Tue Jul 5 16:03:18 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:03:18.288900 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-d711194b-48cc-4c63-b633-c0aa8ac76584 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:03:18.296956 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-d711194b-48cc-4c63-b633-c0aa8ac76584 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011555 Jul 05 16:03:18.297480 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 33/67] 10.222.0.45 () {60 vars in 1285 bytes} [Tue Jul 5 16:03:18 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:03:18.309449 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-3ea00c38-475a-469e-8817-560f37d4c98d admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:03:18.316910 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-3ea00c38-475a-469e-8817-560f37d4c98d admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011854 Jul 05 16:03:18.317412 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 35/68] 10.222.0.45 () {60 vars in 1282 bytes} [Tue Jul 5 16:03:18 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:06:45.024103 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-d711194b-48cc-4c63-b633-c0aa8ac76584 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:06:45.025672 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-d711194b-48cc-4c63-b633-c0aa8ac76584 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001980 Jul 05 16:06:45.026058 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 34/69] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Jul 5 16:06:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:06:45.164236 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG dbcounter [-] [103797] Writing DB stats nova_api:SELECT=6 {{(pid=103797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:06:45.275434 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-92843435-8bbf-4a1b-81e0-d9d9e3ef845a admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:06:45.276598 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 16:06:45.276598 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: warnings.warn(msg) Jul 05 16:06:45.277824 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_concurrency.lockutils [None req-92843435-8bbf-4a1b-81e0-d9d9e3ef845a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:06:45.278261 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_concurrency.lockutils [None req-92843435-8bbf-4a1b-81e0-d9d9e3ef845a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:06:45.279065 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_concurrency.lockutils [None req-92843435-8bbf-4a1b-81e0-d9d9e3ef845a admin admin] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:06:45.279508 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_concurrency.lockutils [None req-92843435-8bbf-4a1b-81e0-d9d9e3ef845a admin admin] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:06:45.313710 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-92843435-8bbf-4a1b-81e0-d9d9e3ef845a admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.150790 Jul 05 16:06:45.314257 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 36/70] 10.222.0.45 () {60 vars in 1193 bytes} [Tue Jul 5 16:06:45 2022] GET /compute/v2.1/os-services => generated 791 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 16:06:46.137626 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-d711194b-48cc-4c63-b633-c0aa8ac76584 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:06:46.138639 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-d711194b-48cc-4c63-b633-c0aa8ac76584 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jul 05 16:06:46.139041 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 35/71] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Jul 5 16:06:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:06:46.329526 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-562a5504-3b11-47f8-b9a6-6b14296b60e9 admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:06:46.330746 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 16:06:46.330746 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: warnings.warn(msg) Jul 05 16:06:46.331945 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_concurrency.lockutils [None req-562a5504-3b11-47f8-b9a6-6b14296b60e9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:06:46.332382 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_concurrency.lockutils [None req-562a5504-3b11-47f8-b9a6-6b14296b60e9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:06:46.333199 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_concurrency.lockutils [None req-562a5504-3b11-47f8-b9a6-6b14296b60e9 admin admin] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:06:46.333627 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_concurrency.lockutils [None req-562a5504-3b11-47f8-b9a6-6b14296b60e9 admin admin] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:06:46.353062 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-562a5504-3b11-47f8-b9a6-6b14296b60e9 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075364 Jul 05 16:06:46.353561 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 37/72] 10.222.0.45 () {60 vars in 1193 bytes} [Tue Jul 5 16:06:46 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 16:06:57.605191 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-d711194b-48cc-4c63-b633-c0aa8ac76584 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:06:57.606197 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-d711194b-48cc-4c63-b633-c0aa8ac76584 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jul 05 16:06:57.606609 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 36/73] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Jul 5 16:06:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:06:57.748531 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG dbcounter [-] [103797] Writing DB stats nova_cell0:SELECT=4 {{(pid=103797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:06:57.749267 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG dbcounter [-] [103797] Writing DB stats nova_cell1:SELECT=4 {{(pid=103797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:06:57.749898 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG dbcounter [-] [103797] Writing DB stats nova_api:SELECT=8 {{(pid=103797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:06:57.797897 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-356c1e4f-e39e-4e50-bfb0-9d9fb0ced790 admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:06:57.799080 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 16:06:57.799080 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: warnings.warn(msg) Jul 05 16:06:57.800298 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_concurrency.lockutils [None req-356c1e4f-e39e-4e50-bfb0-9d9fb0ced790 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:06:57.801085 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_concurrency.lockutils [None req-356c1e4f-e39e-4e50-bfb0-9d9fb0ced790 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:06:57.803524 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_concurrency.lockutils [None req-356c1e4f-e39e-4e50-bfb0-9d9fb0ced790 admin admin] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:06:57.803524 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_concurrency.lockutils [None req-356c1e4f-e39e-4e50-bfb0-9d9fb0ced790 admin admin] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:06:57.831090 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-356c1e4f-e39e-4e50-bfb0-9d9fb0ced790 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086754 Jul 05 16:06:57.831580 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 38/74] 10.222.0.45 () {60 vars in 1193 bytes} [Tue Jul 5 16:06:57 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:06:58.661774 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-d711194b-48cc-4c63-b633-c0aa8ac76584 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:06:58.662769 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-d711194b-48cc-4c63-b633-c0aa8ac76584 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jul 05 16:06:58.663165 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 37/75] 10.222.0.45 () {56 vars in 1074 bytes} [Tue Jul 5 16:06:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:06:58.854134 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-9de630eb-0a16-403b-a5a3-530c9f9804b7 admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:06:58.855292 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 16:06:58.855292 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: warnings.warn(msg) Jul 05 16:06:58.856464 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_concurrency.lockutils [None req-9de630eb-0a16-403b-a5a3-530c9f9804b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:06:58.856934 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_concurrency.lockutils [None req-9de630eb-0a16-403b-a5a3-530c9f9804b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:06:58.857692 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_concurrency.lockutils [None req-9de630eb-0a16-403b-a5a3-530c9f9804b7 admin admin] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:06:58.858106 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_concurrency.lockutils [None req-9de630eb-0a16-403b-a5a3-530c9f9804b7 admin admin] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:06:58.879895 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-9de630eb-0a16-403b-a5a3-530c9f9804b7 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077703 Jul 05 16:06:58.880366 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 39/76] 10.222.0.45 () {60 vars in 1193 bytes} [Tue Jul 5 16:06:58 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:07:53.348989 dv-cinder-848759-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 05 16:07:53.349843 dv-cinder-848759-1-iscsi devstack@n-api.service[103796]: Tue Jul 5 16:07:53 2022 - graceful shutdown triggered... Jul 05 16:07:53.350306 dv-cinder-848759-1-iscsi devstack@n-api.service[103797]: Gracefully killing worker 1 (pid: 103797)... Jul 05 16:07:53.350679 dv-cinder-848759-1-iscsi devstack@n-api.service[103798]: Gracefully killing worker 2 (pid: 103798)... Jul 05 16:07:54.350243 dv-cinder-848759-1-iscsi devstack@n-api.service[103796]: worker 1 buried after 1 seconds Jul 05 16:07:54.350665 dv-cinder-848759-1-iscsi devstack@n-api.service[103796]: worker 2 buried after 1 seconds Jul 05 16:07:54.350665 dv-cinder-848759-1-iscsi devstack@n-api.service[103796]: goodbye to uWSGI. Jul 05 16:07:54.351844 dv-cinder-848759-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 05 16:07:54.352422 dv-cinder-848759-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 05 16:07:54.355756 dv-cinder-848759-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 05 16:07:54.365402 dv-cinder-848759-1-iscsi devstack@n-api.service[118300]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 05 16:07:54.367296 dv-cinder-848759-1-iscsi devstack@n-api.service[118300]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 5 16:07:54 2022] *** Jul 05 16:07:54.367296 dv-cinder-848759-1-iscsi devstack@n-api.service[118300]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 05 16:07:54.367296 dv-cinder-848759-1-iscsi devstack@n-api.service[118300]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 05 16:07:54.367296 dv-cinder-848759-1-iscsi devstack@n-api.service[118300]: nodename: dv-cinder-848759-1-iscsi Jul 05 16:07:54.367296 dv-cinder-848759-1-iscsi devstack@n-api.service[118300]: machine: x86_64 Jul 05 16:07:54.367296 dv-cinder-848759-1-iscsi devstack@n-api.service[118300]: clock source: unix Jul 05 16:07:54.367296 dv-cinder-848759-1-iscsi devstack@n-api.service[118300]: pcre jit disabled Jul 05 16:07:54.367296 dv-cinder-848759-1-iscsi devstack@n-api.service[118300]: detected number of CPU cores: 4 Jul 05 16:07:54.367296 dv-cinder-848759-1-iscsi devstack@n-api.service[118300]: current working directory: / Jul 05 16:07:54.367296 dv-cinder-848759-1-iscsi devstack@n-api.service[118300]: detected binary path: /usr/bin/uwsgi-core Jul 05 16:07:54.367934 dv-cinder-848759-1-iscsi devstack@n-api.service[118300]: your processes number limit is 47680 Jul 05 16:07:54.367934 dv-cinder-848759-1-iscsi devstack@n-api.service[118300]: your memory page size is 4096 bytes Jul 05 16:07:54.367934 dv-cinder-848759-1-iscsi devstack@n-api.service[118300]: detected max file descriptor number: 2048 Jul 05 16:07:54.367934 dv-cinder-848759-1-iscsi devstack@n-api.service[118300]: lock engine: pthread robust mutexes Jul 05 16:07:54.367934 dv-cinder-848759-1-iscsi devstack@n-api.service[118300]: thunder lock: enabled Jul 05 16:07:54.367934 dv-cinder-848759-1-iscsi devstack@n-api.service[118300]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 05 16:07:54.367934 dv-cinder-848759-1-iscsi devstack@n-api.service[118300]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 05 16:07:54.414986 dv-cinder-848759-1-iscsi devstack@n-api.service[118300]: Python main interpreter initialized at 0x558b687299c0 Jul 05 16:07:54.414986 dv-cinder-848759-1-iscsi devstack@n-api.service[118300]: python threads support enabled Jul 05 16:07:54.414986 dv-cinder-848759-1-iscsi devstack@n-api.service[118300]: your server socket listen backlog is limited to 100 connections Jul 05 16:07:54.414986 dv-cinder-848759-1-iscsi devstack@n-api.service[118300]: your mercy for graceful operations on workers is 90 seconds Jul 05 16:07:54.415452 dv-cinder-848759-1-iscsi devstack@n-api.service[118300]: mapped 403077 bytes (393 KB) for 2 cores Jul 05 16:07:54.415452 dv-cinder-848759-1-iscsi devstack@n-api.service[118300]: *** Operational MODE: preforking *** Jul 05 16:07:54.415701 dv-cinder-848759-1-iscsi devstack@n-api.service[118300]: *** uWSGI is running in multiple interpreter mode *** Jul 05 16:07:54.415701 dv-cinder-848759-1-iscsi devstack@n-api.service[118300]: spawned uWSGI master process (pid: 118300) Jul 05 16:07:54.416414 dv-cinder-848759-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 05 16:07:54.417434 dv-cinder-848759-1-iscsi devstack@n-api.service[118300]: spawned uWSGI worker 1 (pid: 118319, cores: 1) Jul 05 16:07:54.417567 dv-cinder-848759-1-iscsi devstack@n-api.service[118300]: spawned uWSGI worker 2 (pid: 118320, cores: 1) Jul 05 16:07:54.418598 dv-cinder-848759-1-iscsi devstack@n-api.service[118300]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 05 16:07:55.080562 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 05 16:07:55.082951 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 05 16:07:56.275144 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 16:07:56.275144 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: from cryptography.utils import int_from_bytes Jul 05 16:07:56.276386 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 16:07:56.276386 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: from cryptography.utils import int_from_bytes Jul 05 16:07:56.277945 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 16:07:56.277945 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: from cryptography.utils import int_from_bytes Jul 05 16:07:56.278380 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 16:07:56.278380 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: from cryptography.utils import int_from_bytes Jul 05 16:07:58.619338 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 16:07:58.619880 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 16:07:58.620065 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 16:07:58.620408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 16:07:58.620667 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 16:07:58.621086 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.621416 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.621743 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.622066 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.622406 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.622722 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.623067 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.623389 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.623744 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.624011 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.624331 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.624677 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848759-1-iscsi {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.625031 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.625345 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.625660 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.625981 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.626293 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.626621 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.626943 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.627442 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.628872 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.628872 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.628872 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.628872 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.629194 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.629467 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.629784 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.630098 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.630429 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.630737 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.631131 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848759-1-iscsi {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.631478 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.631794 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.632109 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.632551 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.632897 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.633224 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.633553 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.633905 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.634204 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.635070 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.635408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.635757 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.636082 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.636393 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.636724 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.637091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.637420 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.637729 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.638041 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.638295 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.638610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.638939 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.639292 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.639622 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.639894 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.640335 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.640686 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.641070 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.641413 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.641751 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.642069 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.642405 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.642741 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.643059 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.643376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.643709 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.644037 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.644381 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.644707 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.645052 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.645383 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.645787 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.646045 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.646358 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.646702 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.647029 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.647344 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.647670 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.647994 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.648306 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.648616 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.648957 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.649285 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.649624 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.649933 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.650756 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.651063 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.651376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.651702 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.652014 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.652326 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.652636 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.652971 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.653285 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.653597 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.653908 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.654220 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.654531 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.654837 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.655147 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.655461 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.655770 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.656097 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.656417 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.656728 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.657062 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.657373 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.657684 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.658008 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.658319 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.658629 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.658953 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.659268 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.659578 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.659898 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.660211 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.660517 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.660868 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.661176 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.661488 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.661808 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.662119 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.662273 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 16:07:58.662745 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.662902 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 16:07:58.663051 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.663191 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 16:07:58.663339 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.663339 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.663634 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 16:07:58.663634 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 16:07:58.663921 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.663921 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.664198 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.664352 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.664505 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.664653 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.664828 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.664984 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.665132 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.665300 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.665460 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.665607 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.665771 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.665920 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.666071 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.666225 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.666376 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.666546 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.666698 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.666847 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.666990 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.667143 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.667303 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.667535 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.667691 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848759-1-iscsi {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.667842 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.667993 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.668143 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.668297 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.668453 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.668594 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.668742 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.669008 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.669159 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.669308 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.669459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.669607 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.669754 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.669904 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.670685 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.670806 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.670932 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.671016 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.671315 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.671410 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.671493 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.671594 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.671676 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.671748 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.671833 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.671906 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.671983 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.672060 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.672141 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.672229 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.672315 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.672509 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.672826 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.672936 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.673037 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.673139 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.673234 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.673583 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.673699 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848759-1-iscsi {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.673898 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.674009 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.674241 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.674345 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.674591 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.674697 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.674906 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.675010 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.675236 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.675329 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.675559 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.675665 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.675872 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.675978 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.676186 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.676290 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.676499 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.676591 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.676845 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.676943 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.677186 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.677281 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.677502 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.677595 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.677822 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.677922 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.678129 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.678229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.678442 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.678541 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.678750 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.678850 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.679069 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.679167 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.679374 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.679480 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.679683 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.679777 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.679936 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.680028 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.680246 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.680346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.680572 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.680675 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.680926 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.681036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.681253 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.681362 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.681535 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.681638 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.681787 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.681888 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.682110 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.682211 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.682435 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.682543 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.682750 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.682854 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.683059 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.683162 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.683369 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.683490 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.683684 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.683868 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.684031 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.684185 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.684328 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.684468 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.684616 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.684759 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.684954 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.685105 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.685253 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.685393 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.685540 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.685694 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.685883 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.686031 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.686171 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.686317 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.686456 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.686661 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.686814 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.686966 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.687131 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.687279 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.687427 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.687581 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.687728 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.687977 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.688133 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.688284 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.688431 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.688587 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.688739 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.689005 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.689158 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.689299 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.689452 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.689600 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.689746 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.689894 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.690037 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.690182 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.690339 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.690486 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.690635 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.690783 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.690943 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.691099 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.691099 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.691382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.691537 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.691694 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.691835 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.691982 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.692132 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.692281 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.692429 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.692652 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.692826 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.692983 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.693126 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.693295 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.693441 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.693589 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.693739 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.693879 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.694018 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.694202 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.694365 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.694508 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.694655 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.694815 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.694966 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.695108 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.695255 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.695403 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.695550 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.695697 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.695851 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.696010 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.696169 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.696319 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.696460 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.696600 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.696833 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.697498 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.697651 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.697793 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.697940 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.698192 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.698352 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.698508 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.698657 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.698807 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.698961 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.699102 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.699250 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.699401 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.699556 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.699696 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.699843 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.699991 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.700138 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.700138 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.700422 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.700570 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.700711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.700885 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.701029 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.701176 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.701343 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.701493 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.701642 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.701792 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.701933 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.702073 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.702221 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.702372 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.702514 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.702679 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.702905 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.703051 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.703204 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.703356 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.703504 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.703645 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.703785 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.703937 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.704079 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.704226 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.704375 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.704523 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.704672 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.704863 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.705012 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.705160 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.705309 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.705449 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.705588 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.705748 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.705890 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.706029 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.706176 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.706323 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.706464 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.706613 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.706763 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.706910 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 16:07:58.707062 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.707209 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.707363 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.707520 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.707662 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.707810 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.707956 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.708103 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.708352 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.708501 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.708651 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.708811 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.708960 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.709112 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.709272 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.709413 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.709568 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.709708 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.709849 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.709989 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.710138 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.710286 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.710434 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.710618 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.710770 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.710935 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.711077 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.711230 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.711373 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.711520 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.711661 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.711813 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.711955 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.712102 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.712243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.712382 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.712522 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.713550 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.713727 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.713877 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.714031 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.714187 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.714334 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.714532 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.714688 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.714844 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.714999 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.715148 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.715309 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.715470 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.715626 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.715784 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.715931 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.716077 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.716233 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.716387 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.716534 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.716680 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.716844 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.717003 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.717165 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.717314 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.717460 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.717623 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.717782 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.717942 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.718097 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.718244 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.718498 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.718664 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.718812 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.718971 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.719126 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.719272 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.719419 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.719573 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.719729 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.719899 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.720054 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.720340 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.720541 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.720704 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.720910 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.721070 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.721218 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.721371 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.721526 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.721683 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.721836 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.722010 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.722158 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.722304 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.722451 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.722451 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.722746 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.722892 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.723045 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.723191 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.723336 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.723565 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.723729 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.723888 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.724053 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.724200 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.724346 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.724492 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.724652 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.724827 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.724990 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.725138 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.725291 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.725443 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.725604 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.725751 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.725896 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.726054 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.726200 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.726356 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.726510 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.726684 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.726971 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.727140 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.727291 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.727452 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.727618 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.727768 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.727914 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.728067 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.728232 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.728388 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.728641 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.728836 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.728991 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.729138 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.729291 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.729448 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.729595 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.729595 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.729873 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.730027 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.730198 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.730353 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.730506 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.730660 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.730814 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.730962 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.731117 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.731264 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.731410 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.731564 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.731710 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.731855 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.732016 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.732173 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.732327 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.732474 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.732630 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.732795 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.732960 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.733109 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.733256 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.733411 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.733583 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.734058 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.734212 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.734368 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.734534 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.734690 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.734845 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.734992 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.735139 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.735292 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.735439 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.735594 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.735748 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.735895 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.736041 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.736188 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.736358 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.736514 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.736896 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.737063 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.737213 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.737366 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.737541 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.737694 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.737841 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.737987 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.738142 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.738297 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.738454 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.738629 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.738868 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.739029 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.739176 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.739330 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.739487 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.739635 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.739788 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.739942 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.740089 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.740248 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.740403 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.740557 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.740715 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.740896 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.741053 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.741213 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.741213 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.741500 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.741500 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.741785 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.741938 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.742163 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.742312 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.742467 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.742621 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.742778 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.742925 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.743084 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.743231 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.743383 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.743537 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.743684 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.743843 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.743990 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.744218 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.744380 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.744536 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.744702 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.744906 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.745146 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.745299 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.745453 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.745602 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.745748 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.745908 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.746063 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.746210 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.746363 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.746509 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.746668 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.746834 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.746982 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.747139 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.747286 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.747431 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.747597 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.747747 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.747892 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.748045 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.748192 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.748338 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.748492 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.748638 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.748858 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.749014 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.749178 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.749416 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.749661 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.749826 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.749982 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.750129 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.750275 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.750428 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.750588 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.750743 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.750898 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.751065 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.751221 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.751423 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.751573 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.751726 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.751875 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.752028 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.752181 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.752341 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.752488 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.752635 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.752807 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.752963 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.753131 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.753293 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.753442 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.753597 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.753744 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.753898 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.754054 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.754228 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.754453 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.754614 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.754811 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.754967 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.755136 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.755291 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.755439 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.755586 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.755739 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.755887 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.756048 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.756197 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.756351 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.756506 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.756654 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.756847 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.757018 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.757186 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.757342 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.757489 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.757657 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.757813 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.757969 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.758149 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.758365 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.758522 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.758671 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.758833 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.759130 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.759292 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.760041 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.760199 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.760356 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.760513 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.760661 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.760826 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.760980 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.761126 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.761274 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.761432 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.761580 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.761734 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.761888 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.762047 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.762202 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.762364 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.762519 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.762667 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.762820 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.762975 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.763131 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.763279 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.763426 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.763579 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.763734 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.763881 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.764051 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.764200 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.764354 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.764593 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.764747 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.764931 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.765089 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.765237 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.765392 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.765547 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.765694 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.765841 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.765997 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.766155 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.766302 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.766448 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.766595 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.766748 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.766904 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.767059 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.767206 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.767359 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.767520 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.767755 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.767905 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.768076 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.768225 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.768380 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.768535 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.768696 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.768893 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.769042 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.769188 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.769352 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.769508 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.769667 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.769814 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.769968 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.770224 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.770388 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.770545 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.770702 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.770858 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.771006 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.771152 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.771298 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.771459 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.771613 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.771613 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.771909 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.772057 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.772218 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.772375 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.772522 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.772676 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.772855 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.773011 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.773158 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.773314 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.773314 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.773608 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.773755 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.773909 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.774080 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.774236 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.774236 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.774530 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.774777 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.774941 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.775690 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.775859 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.776016 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.776172 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.776343 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.776491 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.776638 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.776843 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.776998 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.777156 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.777313 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.777460 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.777622 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.777781 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.777930 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.778086 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.778235 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.778388 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.778536 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.778689 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.778849 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.779005 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.779162 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.779317 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.779465 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.779610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.779765 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.779921 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.780075 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.780241 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.780491 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.780654 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.780823 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.781000 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.781149 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.781305 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.781459 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.781614 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.781776 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.781930 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.782085 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.782243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.782390 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.782702 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.782877 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.783042 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.783191 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.783339 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.783492 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.783647 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.783810 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.783966 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.784113 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.784408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.784577 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.784755 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.785031 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.785031 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.785336 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.785493 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.785641 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.785796 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.785952 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.786109 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.786264 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.786419 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.786567 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.786726 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.786882 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.787029 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.787183 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.787347 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.787496 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.787666 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.787822 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.787969 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.788117 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.788271 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.788419 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.788581 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.788728 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.788908 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.789065 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.789230 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.789386 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.789533 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.789689 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.789844 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.789999 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.790153 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.790153 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.790442 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.790728 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.790887 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.791036 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.791191 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.791368 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.791533 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.791690 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.791845 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.791992 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.792148 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.792303 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.792457 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.792604 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.792759 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.792932 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.793091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.793239 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.793405 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.793568 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.793715 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.793870 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.794026 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.794189 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.794337 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.794571 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.794725 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.794875 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.795031 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.795179 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.795326 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.795484 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.795632 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.795779 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.795942 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.796098 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.796252 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.796399 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.796545 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.796760 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.796985 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.797133 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.797297 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.797446 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.797613 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.797775 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.797924 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.798079 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.798226 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.798380 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.798534 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.798691 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.798838 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.798984 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.799131 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.799278 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.799452 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.799610 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.799758 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.799904 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.800052 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.800198 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.800358 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.800514 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.800661 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.800932 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.801089 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.801250 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.801408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.801566 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.801720 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.801867 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.802020 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.802168 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.802323 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.802480 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.802636 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.802797 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.802945 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.803101 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.803257 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.803404 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.803568 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.803725 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.803880 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.804041 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.804196 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.804345 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.804493 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.804729 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.804916 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.805076 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.805224 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.805379 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.805537 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.805694 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.805842 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.805997 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.806145 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.806327 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.806494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.806653 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.806802 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.806948 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.807095 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.807242 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.807398 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.807569 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.807737 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.807886 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.808041 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.808197 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.808352 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.808510 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.808665 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.808830 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.808984 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.809142 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.809299 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.809447 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.809605 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.809760 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.809914 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.810069 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.810230 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.810385 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.810541 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.810729 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.810882 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.811136 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.811301 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.811450 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.811599 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.811766 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.811915 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.812061 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.812217 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.812365 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.812365 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.812655 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.812820 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.812991 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.813140 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.813287 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.813433 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.813587 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.813745 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.813903 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.814057 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.814212 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.814368 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.814523 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.814523 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.814523 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.814523 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.814523 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.814523 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.814523 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.814523 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.815796 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.815943 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.815943 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.816231 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.816387 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.816387 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.816387 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.816387 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.816387 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.816387 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.817299 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.817457 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.817623 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.817776 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.817924 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.818071 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.818217 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.818442 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.818592 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.818739 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.818894 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.818894 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.819184 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.819339 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.819508 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.819657 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.819815 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.819970 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.820131 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.820279 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.820426 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.820648 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.820827 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.820982 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.821167 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.821424 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.821588 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.821744 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.822419 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.822590 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.822739 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.822886 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.823032 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.823180 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.823327 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.823488 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.823637 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.823784 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.823930 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.824099 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.824099 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.824401 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.824558 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.824712 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.824968 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.825196 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.825362 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.825510 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.825658 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.825811 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.825968 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.826126 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.826288 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.826442 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.826442 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.826878 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.827055 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.827206 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.827369 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.827524 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.827673 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.827828 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.827983 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.828145 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.828318 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.828468 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.828624 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.828797 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.828952 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.829117 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.829265 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.829412 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.829559 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.829713 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.829862 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.830024 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.830173 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.830330 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.830478 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.830625 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.830771 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.830927 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.831086 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.831242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.831242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.831635 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.831792 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.831948 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.832104 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.832269 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.832269 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.832558 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.832720 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.832915 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.833073 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.833228 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.833376 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.833523 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.833686 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.833834 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.833982 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.834136 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.834300 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.834456 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.834617 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.834773 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.834922 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.835069 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.835243 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.835482 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.835645 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.835795 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.835942 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.836096 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.836245 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.836412 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.836560 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.836715 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.836899 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.837057 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.837213 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.837375 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.837556 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.838296 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.838446 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.838602 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.838758 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.838916 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.839074 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.839074 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.839371 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.839520 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.839667 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.839829 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.839978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.840133 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.840290 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.840438 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.840595 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.840595 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.840921 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.841081 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.841229 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.841376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.841537 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.841794 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.841957 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.842114 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.842262 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.842417 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.842580 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.842728 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.842874 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.843034 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.843182 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.843337 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.843494 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.843649 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.843804 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.843951 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.844099 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.844259 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.844407 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.844562 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.844709 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.844899 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.845060 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.845221 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.845370 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.845608 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.845784 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.846025 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.846181 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.846338 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.846990 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.846990 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.847286 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.847442 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.847591 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.847759 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.847915 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.848063 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.848219 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.848385 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.848385 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.848385 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.848838 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.849002 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.849002 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.849002 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.849491 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.849653 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.849809 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.849956 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.850104 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.850249 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.850411 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.850568 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.850715 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.850862 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.851016 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.851165 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.851321 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.851526 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.851696 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.851845 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.852017 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.852264 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.852428 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.852585 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.852734 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.852941 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.853101 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.853101 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.853429 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.853585 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.853748 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.853909 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.854057 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.854057 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.854346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.854501 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.854649 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.854804 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.854951 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.855107 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.855263 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.855417 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.855590 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.855590 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.855975 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.856132 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.856280 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.856280 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.856566 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.856722 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.856907 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.857058 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.857204 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.857358 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.857513 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.857668 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.857836 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.857991 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.858146 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.858304 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.858304 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.858601 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.859021 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.859349 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.859505 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.859653 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.859800 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.859958 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.860124 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.860281 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.860440 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.860440 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.860722 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.860950 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.861102 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.861257 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.861412 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.861560 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.861717 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.861864 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.862034 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.862189 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.862445 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.862609 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.862767 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.862923 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.863081 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.863236 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.863392 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.863554 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.863708 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.863856 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.864026 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.864175 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.864324 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.864479 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.864637 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.864811 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.864976 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.865133 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.865133 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.865423 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.865571 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.865718 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.865956 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.866123 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.866286 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.866449 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.866605 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.866754 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.866909 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.867065 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.867224 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.867372 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.867519 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.867672 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.867821 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.867986 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.867986 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.868294 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.868294 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.868294 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.868706 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.869526 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.869709 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.869869 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.870018 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.870166 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.870316 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.870476 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.870636 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.870791 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.870939 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.871093 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.871247 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.871405 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.871560 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.871715 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.871862 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.872008 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.872161 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.872317 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.872585 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.872739 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.872922 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.873079 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.873236 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.873397 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.873546 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.873693 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.873848 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.873997 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.874158 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.874158 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.874446 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.874606 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.874759 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.874907 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.875064 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.875064 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.875344 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.875344 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.875642 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.875797 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.875972 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.875972 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.876328 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.876475 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.876635 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.876856 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.877026 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.877183 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.877339 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.877486 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.877641 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.877803 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.877960 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.878116 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.878281 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.878438 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.878596 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.878766 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.878766 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.878766 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.878766 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.878766 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.878766 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.879678 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.879829 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.879977 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.880131 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.880289 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.880437 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.880606 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.880755 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.880926 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.881085 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.881241 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.881241 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.881543 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.881700 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.881849 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.881994 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.882148 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.882309 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.882456 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.882641 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.882882 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.883038 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.883192 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.883350 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.883505 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.883659 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.883816 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.883966 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.884122 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.884270 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.884987 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.885169 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.885319 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.885473 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.885630 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.885778 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.885925 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.886072 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.886072 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.886991 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.887154 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.887311 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.887459 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.887607 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.887766 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.887914 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.888070 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.888227 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.888383 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.888538 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.888538 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.888866 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.888866 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.889159 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.889307 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.889455 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.889610 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.889610 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.889910 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.890058 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.890205 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.890360 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.890507 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.890662 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.890820 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.890968 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.891115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.891269 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.891427 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.891585 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.891739 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.891887 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.892041 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 16:07:58.892189 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.892189 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.892189 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.892626 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.892626 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.893076 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.893284 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.895630 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.895630 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.895630 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.895630 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.895630 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.895630 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.895630 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.896936 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.896936 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.896936 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.896936 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.898093 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.898093 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.898093 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.898093 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.898683 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.898683 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.898974 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.899241 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.899619 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.899985 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.900894 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.901228 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.901557 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.901878 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.902205 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.902520 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.902857 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.903206 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.903534 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.903865 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.904177 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.904486 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.904826 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.905145 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.905469 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.905782 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.906090 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.906397 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.906712 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.907021 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.907329 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.907638 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.907946 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.908316 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.908658 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.908893 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.909203 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.909568 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.909812 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.910121 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.910436 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.910744 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.911177 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.911492 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.911802 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.912253 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.912459 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.912997 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.913133 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.913526 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.913846 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.914175 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.914490 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.914816 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.915143 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.915469 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.915815 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.916155 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.916471 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.916806 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.917127 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.917445 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.917759 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.918074 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.918415 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.918743 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.919056 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.919386 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.919708 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.920035 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.920356 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.920672 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.921034 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.921350 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.921664 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.921985 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.922300 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.922616 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.922937 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.923257 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.923886 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.924224 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.924539 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.924892 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.925225 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.925586 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.925904 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.926255 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.926591 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.926909 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.927229 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.927541 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 16:07:58.927789 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 16:07:59.048188 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO dbcounter [None req-a877810b-f838-4523-95ee-c6717e1500a5 None None] Registered counter for database nova_api Jul 05 16:07:59.068596 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_db.sqlalchemy.engines [None req-a877810b-f838-4523-95ee-c6717e1500a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118320) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 16:07:59.076308 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writer thread running {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 16:07:59.080393 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO dbcounter [None req-070ab5e4-3f34-4f4d-a516-1aeb2c54ea0c None None] Registered counter for database nova_api Jul 05 16:07:59.099736 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_db.sqlalchemy.engines [None req-070ab5e4-3f34-4f4d-a516-1aeb2c54ea0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 16:07:59.106665 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writer thread running {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 16:07:59.131962 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.context [None req-a877810b-f838-4523-95ee-c6717e1500a5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),095eb995-5888-495e-a6b9-faa45b31bc81(cell1) {{(pid=118320) load_cells /opt/stack/nova/nova/context.py:464}} Jul 05 16:07:59.136443 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a877810b-f838-4523-95ee-c6717e1500a5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:07:59.138086 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a877810b-f838-4523-95ee-c6717e1500a5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:07:59.138883 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a877810b-f838-4523-95ee-c6717e1500a5 None None] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:07:59.140871 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a877810b-f838-4523-95ee-c6717e1500a5 None None] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:07:59.142869 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO dbcounter [None req-a877810b-f838-4523-95ee-c6717e1500a5 None None] Registered counter for database nova_cell0 Jul 05 16:07:59.146882 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO dbcounter [None req-a877810b-f838-4523-95ee-c6717e1500a5 None None] Registered counter for database nova_cell1 Jul 05 16:07:59.154201 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_db.sqlalchemy.engines [None req-a877810b-f838-4523-95ee-c6717e1500a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118320) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 16:07:59.155957 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_db.sqlalchemy.engines [None req-a877810b-f838-4523-95ee-c6717e1500a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118320) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 16:07:59.162172 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writer thread running {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 16:07:59.163486 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writer thread running {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 16:07:59.164195 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.context [None req-070ab5e4-3f34-4f4d-a516-1aeb2c54ea0c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),095eb995-5888-495e-a6b9-faa45b31bc81(cell1) {{(pid=118319) load_cells /opt/stack/nova/nova/context.py:464}} Jul 05 16:07:59.167669 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-070ab5e4-3f34-4f4d-a516-1aeb2c54ea0c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:07:59.169312 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-070ab5e4-3f34-4f4d-a516-1aeb2c54ea0c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:07:59.170115 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-070ab5e4-3f34-4f4d-a516-1aeb2c54ea0c None None] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:07:59.172080 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-070ab5e4-3f34-4f4d-a516-1aeb2c54ea0c None None] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:07:59.174103 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO dbcounter [None req-070ab5e4-3f34-4f4d-a516-1aeb2c54ea0c None None] Registered counter for database nova_cell0 Jul 05 16:07:59.178183 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO dbcounter [None req-070ab5e4-3f34-4f4d-a516-1aeb2c54ea0c None None] Registered counter for database nova_cell1 Jul 05 16:07:59.186059 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_db.sqlalchemy.engines [None req-070ab5e4-3f34-4f4d-a516-1aeb2c54ea0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 16:07:59.187746 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_db.sqlalchemy.engines [None req-070ab5e4-3f34-4f4d-a516-1aeb2c54ea0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 16:07:59.193293 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writer thread running {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 16:07:59.196126 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writer thread running {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 16:07:59.308478 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO dbcounter [None req-a877810b-f838-4523-95ee-c6717e1500a5 None None] Registered counter for database nova_cell0 Jul 05 16:07:59.315192 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_db.sqlalchemy.engines [None req-a877810b-f838-4523-95ee-c6717e1500a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118320) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 16:07:59.319697 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writer thread running {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 16:07:59.359280 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO dbcounter [None req-070ab5e4-3f34-4f4d-a516-1aeb2c54ea0c None None] Registered counter for database nova_cell0 Jul 05 16:07:59.369623 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_db.sqlalchemy.engines [None req-070ab5e4-3f34-4f4d-a516-1aeb2c54ea0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 16:07:59.375745 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writer thread running {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 16:07:59.641707 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: WARNING keystonemiddleware.auth_token [None req-a877810b-f838-4523-95ee-c6717e1500a5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 05 16:07:59.650580 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: WARNING keystonemiddleware.auth_token [None req-a877810b-f838-4523-95ee-c6717e1500a5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 05 16:07:59.721159 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: WARNING keystonemiddleware.auth_token [None req-070ab5e4-3f34-4f4d-a516-1aeb2c54ea0c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 05 16:07:59.729941 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: WARNING keystonemiddleware.auth_token [None req-070ab5e4-3f34-4f4d-a516-1aeb2c54ea0c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 05 16:08:00.003891 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: WARNING keystonemiddleware.auth_token [None req-a877810b-f838-4523-95ee-c6717e1500a5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 05 16:08:00.010114 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: WARNING keystonemiddleware.auth_token [None req-a877810b-f838-4523-95ee-c6717e1500a5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 05 16:08:00.015500 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558b687299c0 pid: 118320 (default app) Jul 05 16:08:00.076592 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: WARNING keystonemiddleware.auth_token [None req-070ab5e4-3f34-4f4d-a516-1aeb2c54ea0c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 05 16:08:00.082689 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: WARNING keystonemiddleware.auth_token [None req-070ab5e4-3f34-4f4d-a516-1aeb2c54ea0c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 05 16:08:00.088580 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558b687299c0 pid: 118319 (default app) Jul 05 16:08:41.430920 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_api:SELECT=3 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:08:41.431749 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell0:SELECT=3 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:08:41.432716 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=3 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:08:41.433634 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell0:SELECT=3 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:08:42.289549 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_api:SELECT=3 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:08:42.291330 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell1:SELECT=3 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:08:42.292239 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell0:SELECT=3 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:08:42.294810 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell0:SELECT=3 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:08:42.729319 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-765f57df-f3c6-47be-b96a-a14a06a231f6 tempest-VolumesNegativeTest-257725608 tempest-VolumesNegativeTest-257725608-project] Action: 'create', calling method: .version_select at 0x7f3095eac550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1460762989", "metadata": {"Type": "work"}}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:08:42.755408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-765f57df-f3c6-47be-b96a-a14a06a231f6 tempest-VolumesNegativeTest-257725608 tempest-VolumesNegativeTest-257725608-project] Request method failure captured: Jul 05 16:08:42.755408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 05 16:08:42.755408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:08:42.755408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:08:42.755408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:08:42.755408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 122 Jul 05 16:08:42.755408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:08:42.755408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:08:42.755408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:08:42.755408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:08:42.755408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIJWhtehR9EsxSvBR0JDbMmpEyNI046RZ0Puc6KsgSs7YXl-ekpDIY5WZMCc2bR5WYEjo41kq7tgItzEyOD5cKr3Qq_sfr_zJJDVAW2j5cVuNk2UtEdESd8cLDrwr1HR2WmzEt79q4U4nM4bVKxe1isXqiIFYkOxFwfdYaamZEN4h0 Jul 05 16:08:42.755408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:08:42.755408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:08:42.755408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:08:42.755408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:08:42.755408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:08:42.755408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:08:42.755408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 986d1a42da2042aba9eff3da2dc9b12e Jul 05 16:08:42.755408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-VolumesNegativeTest-257725608 Jul 05 16:08:42.755408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:08:42.755408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:08:42.757048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_986d1a42da2042aba9eff3da2dc9b12e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/986d1a42da2042aba9eff3da2dc9b12e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/986d1a42da2042aba9eff3da2dc9b12e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/986d1a42da2042aba9eff3da2dc9b12e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:08:42.757048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-VolumesNegativeTest-257725608 Jul 05 16:08:42.757048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 986d1a42da2042aba9eff3da2dc9b12e Jul 05 16:08:42.757048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-VolumesNegativeTest-257725608 Jul 05 16:08:42.757048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-VolumesNegativeTest-257725608-project Jul 05 16:08:42.757048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:08:42.757048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:08:42.757048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: e65a088d77fd4a55b619c98fa751bb01 Jul 05 16:08:42.757048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-VolumesNegativeTest-257725608-project Jul 05 16:08:42.757048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Jul 05 16:08:42.757048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1460762989", "metadata": {"Type": "work"}}} Jul 05 16:08:42.757048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: Jul 05 16:08:42.757048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 05 16:08:42.758468 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1460762989', 'metadata': {'Type': 'work'}}}} Jul 05 16:08:42.758468 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:08:42.758468 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:42.758468 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 05 16:08:42.758468 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 05 16:08:42.758468 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 05 16:08:42.758468 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise error Jul 05 16:08:42.758468 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 05 16:08:42.758468 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:42.758468 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 05 16:08:42.758468 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 05 16:08:42.758468 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:42.758468 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 05 16:08:42.758468 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi '#$%' Jul 05 16:08:42.758468 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:42.758468 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:08:42.758468 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:42.758468 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:42.758468 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:08:42.758468 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:08:42.758468 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:08:42.758468 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:08:42.759831 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 16:08:42.759831 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 16:08:42.759831 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:08:42.759831 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:08:42.759831 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 05 16:08:42.759831 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 05 16:08:42.759831 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 05 16:08:42.759831 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 05 16:08:42.759831 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 05 16:08:42.759831 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 05 16:08:42.759831 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 05 16:08:42.759831 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:42.759831 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:08:42.759831 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:42.759831 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:42.759831 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:08:42.759831 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:08:42.759831 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 05 16:08:42.759831 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 05 16:08:42.762203 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 05 16:08:42.762203 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:42.762203 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-765f57df-f3c6-47be-b96a-a14a06a231f6 tempest-VolumesNegativeTest-257725608 tempest-VolumesNegativeTest-257725608-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:08:42.762203 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-765f57df-f3c6-47be-b96a-a14a06a231f6 tempest-VolumesNegativeTest-257725608 tempest-VolumesNegativeTest-257725608-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.338503 Jul 05 16:08:42.762203 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 1/1] 10.222.0.45 () {60 vars in 1155 bytes} [Tue Jul 5 16:08:41 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1342 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 05 16:08:42.766961 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-90cdfc1c-5a0f-49ed-96d1-20ea052420ea tempest-VolumesNegativeTest-257725608 tempest-VolumesNegativeTest-257725608-project] Action: 'create', calling method: .version_select at 0x7f3095e308b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1753755939", "metadata": {"Type": "work"}}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:08:42.770122 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-90cdfc1c-5a0f-49ed-96d1-20ea052420ea tempest-VolumesNegativeTest-257725608 tempest-VolumesNegativeTest-257725608-project] Request method failure captured: Jul 05 16:08:42.770122 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 05 16:08:42.770122 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:08:42.770122 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:08:42.770122 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:08:42.770122 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 120 Jul 05 16:08:42.770122 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:08:42.770122 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:08:42.770122 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:08:42.770122 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:08:42.770122 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIJWhtehR9EsxSvBR0JDbMmpEyNI046RZ0Puc6KsgSs7YXl-ekpDIY5WZMCc2bR5WYEjo41kq7tgItzEyOD5cKr3Qq_sfr_zJJDVAW2j5cVuNk2UtEdESd8cLDrwr1HR2WmzEt79q4U4nM4bVKxe1isXqiIFYkOxFwfdYaamZEN4h0 Jul 05 16:08:42.770122 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:08:42.770122 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:08:42.770122 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:08:42.770122 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:08:42.770122 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:08:42.770122 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:08:42.770122 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 986d1a42da2042aba9eff3da2dc9b12e Jul 05 16:08:42.770122 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-VolumesNegativeTest-257725608 Jul 05 16:08:42.770122 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:08:42.770122 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:08:42.771548 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_986d1a42da2042aba9eff3da2dc9b12e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/986d1a42da2042aba9eff3da2dc9b12e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/986d1a42da2042aba9eff3da2dc9b12e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/986d1a42da2042aba9eff3da2dc9b12e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:08:42.771548 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-VolumesNegativeTest-257725608 Jul 05 16:08:42.771548 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 986d1a42da2042aba9eff3da2dc9b12e Jul 05 16:08:42.771548 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-VolumesNegativeTest-257725608 Jul 05 16:08:42.771548 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-VolumesNegativeTest-257725608-project Jul 05 16:08:42.771548 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:08:42.771548 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:08:42.771548 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: e65a088d77fd4a55b619c98fa751bb01 Jul 05 16:08:42.771548 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-VolumesNegativeTest-257725608-project Jul 05 16:08:42.771548 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Jul 05 16:08:42.771548 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1753755939", "metadata": {"Type": "work"}}} Jul 05 16:08:42.771548 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: Jul 05 16:08:42.771548 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 05 16:08:42.772346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1753755939', 'metadata': {'Type': 'work'}}}} Jul 05 16:08:42.772346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:08:42.772346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:42.772346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 05 16:08:42.772346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 05 16:08:42.772346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 05 16:08:42.772346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise error Jul 05 16:08:42.772346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 05 16:08:42.772346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:42.772346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 05 16:08:42.772346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 05 16:08:42.772346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:42.772346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 05 16:08:42.772346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi '0' Jul 05 16:08:42.772346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:42.772346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:08:42.772346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:42.772346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:42.772346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:08:42.772346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:08:42.772346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:08:42.772346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:08:42.773712 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 16:08:42.773712 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 16:08:42.773712 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:08:42.773712 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:08:42.773712 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 05 16:08:42.773712 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 05 16:08:42.773712 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 05 16:08:42.773712 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 05 16:08:42.773712 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 05 16:08:42.773712 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 05 16:08:42.773712 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 05 16:08:42.773712 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:42.773712 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:08:42.773712 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:42.773712 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:42.773712 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:08:42.773712 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:08:42.773712 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 05 16:08:42.773712 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 05 16:08:42.774822 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 05 16:08:42.774822 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:42.777356 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-90cdfc1c-5a0f-49ed-96d1-20ea052420ea tempest-VolumesNegativeTest-257725608 tempest-VolumesNegativeTest-257725608-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:08:42.778476 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-90cdfc1c-5a0f-49ed-96d1-20ea052420ea tempest-VolumesNegativeTest-257725608 tempest-VolumesNegativeTest-257725608-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016289 Jul 05 16:08:42.787217 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 2/2] 10.222.0.45 () {60 vars in 1155 bytes} [Tue Jul 5 16:08:42 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 05 16:08:42.794851 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-7de8ea0d-58ac-4865-88a0-0c861da47192 tempest-VolumesNegativeTest-257725608 tempest-VolumesNegativeTest-257725608-project] Action: 'create', calling method: .version_select at 0x7f3095eac790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-909107991", "metadata": {"Type": "work"}}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:08:42.797173 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-7de8ea0d-58ac-4865-88a0-0c861da47192 tempest-VolumesNegativeTest-257725608 tempest-VolumesNegativeTest-257725608-project] Request method failure captured: Jul 05 16:08:42.797173 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 05 16:08:42.797173 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:08:42.797173 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:08:42.797173 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:08:42.797173 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 118 Jul 05 16:08:42.797173 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:08:42.797173 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:08:42.797173 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:08:42.797173 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:08:42.797173 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIJWhtehR9EsxSvBR0JDbMmpEyNI046RZ0Puc6KsgSs7YXl-ekpDIY5WZMCc2bR5WYEjo41kq7tgItzEyOD5cKr3Qq_sfr_zJJDVAW2j5cVuNk2UtEdESd8cLDrwr1HR2WmzEt79q4U4nM4bVKxe1isXqiIFYkOxFwfdYaamZEN4h0 Jul 05 16:08:42.797173 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:08:42.797173 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:08:42.797173 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:08:42.797173 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:08:42.797173 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:08:42.797173 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:08:42.797173 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 986d1a42da2042aba9eff3da2dc9b12e Jul 05 16:08:42.797173 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-VolumesNegativeTest-257725608 Jul 05 16:08:42.797173 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:08:42.797173 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:08:42.798500 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_986d1a42da2042aba9eff3da2dc9b12e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/986d1a42da2042aba9eff3da2dc9b12e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/986d1a42da2042aba9eff3da2dc9b12e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/986d1a42da2042aba9eff3da2dc9b12e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:08:42.798500 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-VolumesNegativeTest-257725608 Jul 05 16:08:42.798500 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 986d1a42da2042aba9eff3da2dc9b12e Jul 05 16:08:42.798500 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-VolumesNegativeTest-257725608 Jul 05 16:08:42.798500 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-VolumesNegativeTest-257725608-project Jul 05 16:08:42.798500 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:08:42.798500 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:08:42.798500 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: e65a088d77fd4a55b619c98fa751bb01 Jul 05 16:08:42.798500 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-VolumesNegativeTest-257725608-project Jul 05 16:08:42.798500 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Jul 05 16:08:42.798500 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-909107991", "metadata": {"Type": "work"}}} Jul 05 16:08:42.798500 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: Jul 05 16:08:42.798500 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 05 16:08:42.799242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-909107991', 'metadata': {'Type': 'work'}}}} Jul 05 16:08:42.799242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:08:42.799242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:42.799242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 05 16:08:42.799242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 05 16:08:42.799242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 05 16:08:42.799242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise error Jul 05 16:08:42.799242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 05 16:08:42.799242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:42.799242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 05 16:08:42.799242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 05 16:08:42.799242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:42.799242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 05 16:08:42.799242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi '' Jul 05 16:08:42.799242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:42.799242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:08:42.799242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:42.799242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:42.799242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:08:42.799242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:08:42.799242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:08:42.799242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:08:42.800627 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 16:08:42.800627 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 16:08:42.800627 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:08:42.800627 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:08:42.800627 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 05 16:08:42.800627 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 05 16:08:42.800627 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 05 16:08:42.800627 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 05 16:08:42.800627 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 05 16:08:42.800627 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 05 16:08:42.800627 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 05 16:08:42.800627 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:42.800627 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:08:42.800627 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:42.800627 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:42.800627 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:08:42.800627 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:08:42.800627 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 05 16:08:42.800627 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 05 16:08:42.801841 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 05 16:08:42.801841 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:42.801841 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-7de8ea0d-58ac-4865-88a0-0c861da47192 tempest-VolumesNegativeTest-257725608 tempest-VolumesNegativeTest-257725608-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:08:42.801841 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-7de8ea0d-58ac-4865-88a0-0c861da47192 tempest-VolumesNegativeTest-257725608 tempest-VolumesNegativeTest-257725608-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007481 Jul 05 16:08:42.801841 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 3/3] 10.222.0.45 () {60 vars in 1155 bytes} [Tue Jul 5 16:08:42 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 05 16:08:42.817431 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-cd6a142d-1108-4886-a961-8300c690c1b0 tempest-VolumesNegativeTest-257725608 tempest-VolumesNegativeTest-257725608-project] Calling method '.version_select at 0x7f3095dd95e0>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:08:42.940267 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-cb988b14-6e16-4cba-a3ed-7347f5c80009 tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] Action: 'create', calling method: .version_select at 0x7f3095eae5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-152159445"}} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:08:43.101805 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-cd6a142d-1108-4886-a961-8300c690c1b0 tempest-VolumesNegativeTest-257725608 tempest-VolumesNegativeTest-257725608-project] HTTP exception thrown: Volume tempest-invalid-546594421 could not be found. Jul 05 16:08:43.107243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-cd6a142d-1108-4886-a961-8300c690c1b0 tempest-VolumesNegativeTest-257725608 tempest-VolumesNegativeTest-257725608-project] Request method failure captured: Jul 05 16:08:43.107243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-546594421 HTTP/1.1 Jul 05 16:08:43.107243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:08:43.107243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:08:43.107243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:08:43.107243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:08:43.107243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:08:43.107243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:08:43.107243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:08:43.107243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:08:43.107243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIJWhtehR9EsxSvBR0JDbMmpEyNI046RZ0Puc6KsgSs7YXl-ekpDIY5WZMCc2bR5WYEjo41kq7tgItzEyOD5cKr3Qq_sfr_zJJDVAW2j5cVuNk2UtEdESd8cLDrwr1HR2WmzEt79q4U4nM4bVKxe1isXqiIFYkOxFwfdYaamZEN4h0 Jul 05 16:08:43.107243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:08:43.107243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:08:43.107243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:08:43.107243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:08:43.107243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:08:43.107243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:08:43.107243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 986d1a42da2042aba9eff3da2dc9b12e Jul 05 16:08:43.107243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-VolumesNegativeTest-257725608 Jul 05 16:08:43.107243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:08:43.107243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:08:43.108514 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_986d1a42da2042aba9eff3da2dc9b12e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/986d1a42da2042aba9eff3da2dc9b12e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/986d1a42da2042aba9eff3da2dc9b12e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/986d1a42da2042aba9eff3da2dc9b12e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:08:43.108514 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-VolumesNegativeTest-257725608 Jul 05 16:08:43.108514 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 986d1a42da2042aba9eff3da2dc9b12e Jul 05 16:08:43.108514 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-VolumesNegativeTest-257725608 Jul 05 16:08:43.108514 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-VolumesNegativeTest-257725608-project Jul 05 16:08:43.108514 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:08:43.108514 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:08:43.108514 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: e65a088d77fd4a55b619c98fa751bb01 Jul 05 16:08:43.108514 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-VolumesNegativeTest-257725608-project Jul 05 16:08:43.108514 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: Jul 05 16:08:43.108514 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Volume tempest-invalid-546594421 could not be found. Jul 05 16:08:43.108514 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': 'tempest-invalid-546594421'} Jul 05 16:08:43.108514 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:08:43.109610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:43.109610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 16:08:43.109610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 16:08:43.109610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 05 16:08:43.109610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 05 16:08:43.109610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 05 16:08:43.109610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 05 16:08:43.109610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 05 16:08:43.109610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 05 16:08:43.109610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 05 16:08:43.109610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 05 16:08:43.109610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 16:08:43.109610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 16:08:43.109610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 16:08:43.109610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 16:08:43.109610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-546594421 could not be found. (HTTP 404) (Request-ID: req-ece9c96b-c57c-4192-b1e4-6d4cf99c7520) Jul 05 16:08:43.109610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:43.109610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:08:43.109610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:43.110780 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:43.110780 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 05 16:08:43.110780 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 05 16:08:43.110780 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 05 16:08:43.110780 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 05 16:08:43.110780 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 05 16:08:43.110780 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 05 16:08:43.110780 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 05 16:08:43.110780 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 16:08:43.110780 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 16:08:43.110780 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 16:08:43.110780 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 05 16:08:43.110780 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 05 16:08:43.110780 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 05 16:08:43.110780 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 05 16:08:43.110780 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 05 16:08:43.110780 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 05 16:08:43.110780 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 05 16:08:43.110780 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 05 16:08:43.111895 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 16:08:43.111895 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 16:08:43.111895 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 16:08:43.111895 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 16:08:43.111895 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-546594421 could not be found. Jul 05 16:08:43.111895 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:43.111895 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:08:43.111895 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:43.111895 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:43.111895 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:08:43.111895 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:08:43.111895 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:08:43.111895 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:08:43.111895 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 16:08:43.111895 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 16:08:43.111895 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:08:43.111895 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:08:43.111895 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 05 16:08:43.111895 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:08:43.111895 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-546594421 could not be found. Jul 05 16:08:43.115321 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:43.115321 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:08:43.115321 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:43.115321 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:43.115321 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:08:43.115321 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:08:43.115321 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:08:43.115321 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:08:43.115321 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-546594421 could not be found. Jul 05 16:08:43.115321 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:43.121245 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-cd6a142d-1108-4886-a961-8300c690c1b0 tempest-VolumesNegativeTest-257725608 tempest-VolumesNegativeTest-257725608-project] Returning 404 to user: Volume tempest-invalid-546594421 could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:08:43.123781 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-cd6a142d-1108-4886-a961-8300c690c1b0 tempest-VolumesNegativeTest-257725608 tempest-VolumesNegativeTest-257725608-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/tempest-invalid-546594421" status: 404 len: 98 microversion: 2.1 time: 0.313516 Jul 05 16:08:43.125564 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 4/4] 10.222.0.45 () {58 vars in 1214 bytes} [Tue Jul 5 16:08:42 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-546594421 => generated 98 bytes in 320 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 05 16:08:43.144702 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-d657f930-8b9c-4737-a48c-49999c3ec87d tempest-VolumesNegativeTest-257725608 tempest-VolumesNegativeTest-257725608-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010233 Jul 05 16:08:43.144702 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 5/5] 10.222.0.45 () {58 vars in 1139 bytes} [Tue Jul 5 16:08:43 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 05 16:08:43.186739 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-a6fad0b6-07ef-4299-ac84-9518501c447f tempest-VolumesNegativeTest-257725608 tempest-VolumesNegativeTest-257725608-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.022183 Jul 05 16:08:43.186739 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 6/6] 10.222.0.45 () {58 vars in 1136 bytes} [Tue Jul 5 16:08:43 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 05 16:08:43.190663 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-29894874-297e-44f5-bb57-e53a75ccdb98 tempest-VolumesNegativeTest-257725608 tempest-VolumesNegativeTest-257725608-project] Calling method '.version_select at 0x7f3095d039d0>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:08:43.324214 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-29894874-297e-44f5-bb57-e53a75ccdb98 tempest-VolumesNegativeTest-257725608 tempest-VolumesNegativeTest-257725608-project] HTTP exception thrown: Volume 8358a460-8178-48d6-aac6-7ce575a1966e could not be found. Jul 05 16:08:43.324214 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-29894874-297e-44f5-bb57-e53a75ccdb98 tempest-VolumesNegativeTest-257725608 tempest-VolumesNegativeTest-257725608-project] Request method failure captured: Jul 05 16:08:43.324214 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: DELETE /compute/v2.1/os-volumes/8358a460-8178-48d6-aac6-7ce575a1966e HTTP/1.1 Jul 05 16:08:43.324214 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:08:43.324214 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:08:43.324214 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:08:43.324214 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:08:43.324214 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:08:43.324214 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:08:43.324214 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:08:43.324214 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:08:43.324214 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIJWhtehR9EsxSvBR0JDbMmpEyNI046RZ0Puc6KsgSs7YXl-ekpDIY5WZMCc2bR5WYEjo41kq7tgItzEyOD5cKr3Qq_sfr_zJJDVAW2j5cVuNk2UtEdESd8cLDrwr1HR2WmzEt79q4U4nM4bVKxe1isXqiIFYkOxFwfdYaamZEN4h0 Jul 05 16:08:43.324214 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:08:43.324214 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:08:43.324214 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:08:43.324214 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:08:43.324214 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:08:43.324214 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:08:43.324214 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 986d1a42da2042aba9eff3da2dc9b12e Jul 05 16:08:43.324214 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-VolumesNegativeTest-257725608 Jul 05 16:08:43.324214 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:08:43.324214 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:08:43.326346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_986d1a42da2042aba9eff3da2dc9b12e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/986d1a42da2042aba9eff3da2dc9b12e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/986d1a42da2042aba9eff3da2dc9b12e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/986d1a42da2042aba9eff3da2dc9b12e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:08:43.326346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-VolumesNegativeTest-257725608 Jul 05 16:08:43.326346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 986d1a42da2042aba9eff3da2dc9b12e Jul 05 16:08:43.326346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-VolumesNegativeTest-257725608 Jul 05 16:08:43.326346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-VolumesNegativeTest-257725608-project Jul 05 16:08:43.326346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:08:43.326346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:08:43.326346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: e65a088d77fd4a55b619c98fa751bb01 Jul 05 16:08:43.326346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-VolumesNegativeTest-257725608-project Jul 05 16:08:43.326346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: Jul 05 16:08:43.326346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Volume 8358a460-8178-48d6-aac6-7ce575a1966e could not be found. Jul 05 16:08:43.326346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': '8358a460-8178-48d6-aac6-7ce575a1966e'} Jul 05 16:08:43.326346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:08:43.327098 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:43.327098 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 16:08:43.327098 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 16:08:43.327098 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 05 16:08:43.327098 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 05 16:08:43.327098 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 05 16:08:43.327098 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 05 16:08:43.327098 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 05 16:08:43.327098 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 05 16:08:43.327098 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 05 16:08:43.327098 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 05 16:08:43.327098 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 16:08:43.327098 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 16:08:43.327098 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 16:08:43.327098 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 16:08:43.327098 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8358a460-8178-48d6-aac6-7ce575a1966e could not be found. (HTTP 404) (Request-ID: req-c4e72dd6-2be8-4116-b5d5-184de62a6253) Jul 05 16:08:43.327098 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:43.327098 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:08:43.327098 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:43.328169 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:43.328169 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 05 16:08:43.328169 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 05 16:08:43.328169 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 05 16:08:43.328169 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 05 16:08:43.328169 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 05 16:08:43.328169 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 05 16:08:43.328169 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 05 16:08:43.328169 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 16:08:43.328169 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 16:08:43.328169 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 16:08:43.328169 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 05 16:08:43.328169 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 05 16:08:43.328169 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 05 16:08:43.328169 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 05 16:08:43.328169 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 05 16:08:43.328169 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 05 16:08:43.328169 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 05 16:08:43.328169 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 05 16:08:43.330804 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 16:08:43.330804 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 16:08:43.330804 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 16:08:43.330804 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 16:08:43.330804 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8358a460-8178-48d6-aac6-7ce575a1966e could not be found. Jul 05 16:08:43.330804 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:43.330804 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:08:43.330804 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:43.330804 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:43.330804 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:08:43.330804 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:08:43.330804 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:08:43.330804 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:08:43.330804 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 16:08:43.330804 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 16:08:43.330804 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:08:43.330804 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:08:43.330804 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 05 16:08:43.330804 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:08:43.333799 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8358a460-8178-48d6-aac6-7ce575a1966e could not be found. Jul 05 16:08:43.333799 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:43.333799 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:08:43.333799 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:43.333799 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:43.333799 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:08:43.333799 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:08:43.333799 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:08:43.333799 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:08:43.333799 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8358a460-8178-48d6-aac6-7ce575a1966e could not be found. Jul 05 16:08:43.333799 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:43.333799 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-29894874-297e-44f5-bb57-e53a75ccdb98 tempest-VolumesNegativeTest-257725608 tempest-VolumesNegativeTest-257725608-project] Returning 404 to user: Volume 8358a460-8178-48d6-aac6-7ce575a1966e could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:08:43.333799 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-29894874-297e-44f5-bb57-e53a75ccdb98 tempest-VolumesNegativeTest-257725608 tempest-VolumesNegativeTest-257725608-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/8358a460-8178-48d6-aac6-7ce575a1966e" status: 404 len: 109 microversion: 2.1 time: 0.128714 Jul 05 16:08:43.333799 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 7/7] 10.222.0.45 () {58 vars in 1247 bytes} [Tue Jul 5 16:08:43 2022] DELETE /compute/v2.1/os-volumes/8358a460-8178-48d6-aac6-7ce575a1966e => generated 109 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 16:08:43.342263 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-1a39bf85-adf0-4371-b7ff-4c0bbc756945 tempest-VolumesNegativeTest-257725608 tempest-VolumesNegativeTest-257725608-project] Calling method '.version_select at 0x7f3095d03e50>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:08:43.401109 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-1a39bf85-adf0-4371-b7ff-4c0bbc756945 tempest-VolumesNegativeTest-257725608 tempest-VolumesNegativeTest-257725608-project] HTTP exception thrown: Volume 11cb22e9-1b58-4db9-a681-9b19363ea68d could not be found. Jul 05 16:08:43.403555 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-1a39bf85-adf0-4371-b7ff-4c0bbc756945 tempest-VolumesNegativeTest-257725608 tempest-VolumesNegativeTest-257725608-project] Request method failure captured: Jul 05 16:08:43.403555 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: GET /compute/v2.1/os-volumes/11cb22e9-1b58-4db9-a681-9b19363ea68d HTTP/1.1 Jul 05 16:08:43.403555 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:08:43.403555 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:08:43.403555 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:08:43.403555 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:08:43.403555 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:08:43.403555 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:08:43.403555 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:08:43.403555 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:08:43.403555 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIJWhtehR9EsxSvBR0JDbMmpEyNI046RZ0Puc6KsgSs7YXl-ekpDIY5WZMCc2bR5WYEjo41kq7tgItzEyOD5cKr3Qq_sfr_zJJDVAW2j5cVuNk2UtEdESd8cLDrwr1HR2WmzEt79q4U4nM4bVKxe1isXqiIFYkOxFwfdYaamZEN4h0 Jul 05 16:08:43.403555 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:08:43.403555 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:08:43.403555 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:08:43.403555 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:08:43.403555 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:08:43.403555 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:08:43.403555 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 986d1a42da2042aba9eff3da2dc9b12e Jul 05 16:08:43.403555 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-VolumesNegativeTest-257725608 Jul 05 16:08:43.403555 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:08:43.403555 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:08:43.405491 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_986d1a42da2042aba9eff3da2dc9b12e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/986d1a42da2042aba9eff3da2dc9b12e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/986d1a42da2042aba9eff3da2dc9b12e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/986d1a42da2042aba9eff3da2dc9b12e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:08:43.405491 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-VolumesNegativeTest-257725608 Jul 05 16:08:43.405491 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 986d1a42da2042aba9eff3da2dc9b12e Jul 05 16:08:43.405491 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-VolumesNegativeTest-257725608 Jul 05 16:08:43.405491 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-VolumesNegativeTest-257725608-project Jul 05 16:08:43.405491 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:08:43.405491 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:08:43.405491 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: e65a088d77fd4a55b619c98fa751bb01 Jul 05 16:08:43.405491 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-VolumesNegativeTest-257725608-project Jul 05 16:08:43.405491 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: Jul 05 16:08:43.405491 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Volume 11cb22e9-1b58-4db9-a681-9b19363ea68d could not be found. Jul 05 16:08:43.405491 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': '11cb22e9-1b58-4db9-a681-9b19363ea68d'} Jul 05 16:08:43.405491 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:08:43.406901 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:43.406901 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 16:08:43.406901 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 16:08:43.406901 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 05 16:08:43.406901 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 05 16:08:43.406901 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 05 16:08:43.406901 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 05 16:08:43.406901 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 16:08:43.406901 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 16:08:43.406901 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 16:08:43.406901 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 16:08:43.406901 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 16:08:43.406901 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 16:08:43.406901 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 16:08:43.406901 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 16:08:43.406901 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 11cb22e9-1b58-4db9-a681-9b19363ea68d could not be found. (HTTP 404) (Request-ID: req-4d5a87ec-9046-4806-881b-bb387a8c6e47) Jul 05 16:08:43.406901 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:43.406901 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:08:43.406901 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:43.408255 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:43.408255 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 05 16:08:43.408255 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 05 16:08:43.408255 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 05 16:08:43.408255 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 05 16:08:43.408255 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 05 16:08:43.408255 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 05 16:08:43.408255 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 05 16:08:43.408255 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 16:08:43.408255 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 16:08:43.408255 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 16:08:43.408255 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 05 16:08:43.408255 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 05 16:08:43.408255 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 05 16:08:43.408255 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 05 16:08:43.408255 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 16:08:43.408255 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 16:08:43.408255 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 16:08:43.408255 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 16:08:43.409376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 16:08:43.409376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 16:08:43.409376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 16:08:43.409376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 16:08:43.409376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 11cb22e9-1b58-4db9-a681-9b19363ea68d could not be found. Jul 05 16:08:43.409376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:43.409376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:08:43.409376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:43.409376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:43.409376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:08:43.409376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:08:43.409376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:08:43.409376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:08:43.409376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 16:08:43.409376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 16:08:43.409376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:08:43.409376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:08:43.409376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 05 16:08:43.409376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:08:43.410843 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 11cb22e9-1b58-4db9-a681-9b19363ea68d could not be found. Jul 05 16:08:43.410843 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:43.410843 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:08:43.410843 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:43.410843 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:43.410843 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:08:43.410843 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:08:43.410843 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:08:43.410843 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:08:43.410843 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 11cb22e9-1b58-4db9-a681-9b19363ea68d could not be found. Jul 05 16:08:43.410843 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:43.410843 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-1a39bf85-adf0-4371-b7ff-4c0bbc756945 tempest-VolumesNegativeTest-257725608 tempest-VolumesNegativeTest-257725608-project] Returning 404 to user: Volume 11cb22e9-1b58-4db9-a681-9b19363ea68d could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:08:43.410843 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-1a39bf85-adf0-4371-b7ff-4c0bbc756945 tempest-VolumesNegativeTest-257725608 tempest-VolumesNegativeTest-257725608-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/11cb22e9-1b58-4db9-a681-9b19363ea68d" status: 404 len: 109 microversion: 2.1 time: 0.083911 Jul 05 16:08:43.410843 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 8/8] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Jul 5 16:08:43 2022] GET /compute/v2.1/os-volumes/11cb22e9-1b58-4db9-a681-9b19363ea68d => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 16:08:44.383258 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-cb988b14-6e16-4cba-a3ed-7347f5c80009 tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.104341 Jul 05 16:08:44.384687 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 1/9] 10.222.0.45 () {60 vars in 1154 bytes} [Tue Jul 5 16:08:42 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2110 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 05 16:08:44.401734 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-c406d985-2d46-40db-91f2-a8f6b13ddb04 tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] Calling method '.version_select at 0x7f3095d03b80>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:08:44.506703 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-c406d985-2d46-40db-91f2-a8f6b13ddb04 tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/6b29b225-1884-4c07-bcec-f4415f2942f6" status: 200 len: 344 microversion: 2.1 time: 0.113473 Jul 05 16:08:44.515178 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 9/10] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Jul 5 16:08:44 2022] GET /compute/v2.1/os-volumes/6b29b225-1884-4c07-bcec-f4415f2942f6 => generated 344 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:08:45.520185 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-9502d7e4-ba5b-4c64-8bf8-8f83b6f8b93c tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] Calling method '.version_select at 0x7f3095d744c0>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:08:45.592850 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-9502d7e4-ba5b-4c64-8bf8-8f83b6f8b93c tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/6b29b225-1884-4c07-bcec-f4415f2942f6" status: 200 len: 344 microversion: 2.1 time: 0.076892 Jul 05 16:08:45.599266 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 2/11] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Jul 5 16:08:45 2022] GET /compute/v2.1/os-volumes/6b29b225-1884-4c07-bcec-f4415f2942f6 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:08:46.606480 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-39183854-ee0c-4bd3-ab15-7a2718a488d3 tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] Calling method '.version_select at 0x7f3095d03040>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:08:46.763381 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-39183854-ee0c-4bd3-ab15-7a2718a488d3 tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/6b29b225-1884-4c07-bcec-f4415f2942f6" status: 200 len: 345 microversion: 2.1 time: 0.160851 Jul 05 16:08:46.765831 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 10/12] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Jul 5 16:08:46 2022] GET /compute/v2.1/os-volumes/6b29b225-1884-4c07-bcec-f4415f2942f6 => generated 345 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:08:46.777131 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-a544cb8b-9eab-41be-a490-4c755989039c tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] Action: 'create', calling method: .version_select at 0x7f3095d74790>, body: {"snapshot": {"volume_id": "6b29b225-1884-4c07-bcec-f4415f2942f6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1794401788"}} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:08:47.588619 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-a544cb8b-9eab-41be-a490-4c755989039c tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] 10.222.0.45 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.815419 Jul 05 16:08:47.594085 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 3/13] 10.222.0.45 () {60 vars in 1161 bytes} [Tue Jul 5 16:08:46 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:08:47.599620 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-bfb43d16-3f82-4a61-a8b2-f33469f2fdd4 tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] Calling method '.version_select at 0x7f3095eac820>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:08:47.788261 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-bfb43d16-3f82-4a61-a8b2-f33469f2fdd4 tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/ed98bab6-ea65-4031-af0d-1d0be54e8d04" status: 200 len: 287 microversion: 2.1 time: 0.192439 Jul 05 16:08:47.790022 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 11/14] 10.222.0.45 () {58 vars in 1250 bytes} [Tue Jul 5 16:08:47 2022] GET /compute/v2.1/os-snapshots/ed98bab6-ea65-4031-af0d-1d0be54e8d04 => generated 287 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:08:47.800159 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-363f13b3-dad6-4aa7-8c70-9843b23101e8 tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] Calling method '.version_select at 0x7f3095d8b0d0>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:08:47.876678 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-363f13b3-dad6-4aa7-8c70-9843b23101e8 tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.080547 Jul 05 16:08:47.878391 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 4/15] 10.222.0.45 () {58 vars in 1139 bytes} [Tue Jul 5 16:08:47 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:08:47.889353 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-9ed1b1a7-c3f8-4fb2-bc31-048ce79e34a1 tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] Calling method '.version_select at 0x7f3095e308b0>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:08:47.965894 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-9ed1b1a7-c3f8-4fb2-bc31-048ce79e34a1 tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/ed98bab6-ea65-4031-af0d-1d0be54e8d04" status: 200 len: 287 microversion: 2.1 time: 0.080676 Jul 05 16:08:47.970029 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 12/16] 10.222.0.45 () {58 vars in 1250 bytes} [Tue Jul 5 16:08:47 2022] GET /compute/v2.1/os-snapshots/ed98bab6-ea65-4031-af0d-1d0be54e8d04 => generated 287 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:08:48.978020 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-abaf770e-1e75-40d0-bb5a-283377cac623 tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] Calling method '.version_select at 0x7f3095d8bdc0>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:08:49.039843 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-abaf770e-1e75-40d0-bb5a-283377cac623 tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/ed98bab6-ea65-4031-af0d-1d0be54e8d04" status: 200 len: 287 microversion: 2.1 time: 0.065764 Jul 05 16:08:49.044236 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 5/17] 10.222.0.45 () {58 vars in 1250 bytes} [Tue Jul 5 16:08:48 2022] GET /compute/v2.1/os-snapshots/ed98bab6-ea65-4031-af0d-1d0be54e8d04 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:08:50.051515 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-28df7c4d-1da8-4be6-b259-51f2b8a2bf96 tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] Calling method '.version_select at 0x7f3095dd9160>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:08:50.103568 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-28df7c4d-1da8-4be6-b259-51f2b8a2bf96 tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/ed98bab6-ea65-4031-af0d-1d0be54e8d04" status: 200 len: 287 microversion: 2.1 time: 0.055812 Jul 05 16:08:50.109080 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 13/18] 10.222.0.45 () {58 vars in 1250 bytes} [Tue Jul 5 16:08:50 2022] GET /compute/v2.1/os-snapshots/ed98bab6-ea65-4031-af0d-1d0be54e8d04 => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:08:51.116307 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-2e1ba863-e0b2-4edc-89db-dc3435350546 tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] Calling method '.version_select at 0x7f3095d8baf0>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:08:51.176919 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-2e1ba863-e0b2-4edc-89db-dc3435350546 tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/ed98bab6-ea65-4031-af0d-1d0be54e8d04" status: 200 len: 288 microversion: 2.1 time: 0.064858 Jul 05 16:08:51.183705 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 6/19] 10.222.0.45 () {58 vars in 1250 bytes} [Tue Jul 5 16:08:51 2022] GET /compute/v2.1/os-snapshots/ed98bab6-ea65-4031-af0d-1d0be54e8d04 => generated 288 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:08:51.188953 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-1d4220e9-6927-47a6-b8d9-98f02ab6be83 tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] Calling method '.version_select at 0x7f3095d03280>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:08:51.441761 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-1d4220e9-6927-47a6-b8d9-98f02ab6be83 tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] 10.222.0.45 "DELETE /compute/v2.1/os-snapshots/ed98bab6-ea65-4031-af0d-1d0be54e8d04" status: 202 len: 0 microversion: 2.1 time: 0.256779 Jul 05 16:08:51.442627 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 14/20] 10.222.0.45 () {58 vars in 1253 bytes} [Tue Jul 5 16:08:51 2022] DELETE /compute/v2.1/os-snapshots/ed98bab6-ea65-4031-af0d-1d0be54e8d04 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 05 16:08:51.451350 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-4f82c164-6dba-47dc-84c1-36e4ede16aac tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] Calling method '.version_select at 0x7f3095d8b550>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:08:51.836280 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-4f82c164-6dba-47dc-84c1-36e4ede16aac tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/ed98bab6-ea65-4031-af0d-1d0be54e8d04" status: 200 len: 287 microversion: 2.1 time: 0.388982 Jul 05 16:08:51.840600 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 7/21] 10.222.0.45 () {58 vars in 1250 bytes} [Tue Jul 5 16:08:51 2022] GET /compute/v2.1/os-snapshots/ed98bab6-ea65-4031-af0d-1d0be54e8d04 => generated 287 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:08:52.847799 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-5fb4c7b0-d961-47ee-b9de-91dc102163ee tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] Calling method '.version_select at 0x7f3095d03700>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:08:52.883951 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-5fb4c7b0-d961-47ee-b9de-91dc102163ee tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] HTTP exception thrown: Snapshot ed98bab6-ea65-4031-af0d-1d0be54e8d04 could not be found. Jul 05 16:08:52.887243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-5fb4c7b0-d961-47ee-b9de-91dc102163ee tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] Request method failure captured: Jul 05 16:08:52.887243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: GET /compute/v2.1/os-snapshots/ed98bab6-ea65-4031-af0d-1d0be54e8d04 HTTP/1.1 Jul 05 16:08:52.887243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:08:52.887243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:08:52.887243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:08:52.887243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:08:52.887243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:08:52.887243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:08:52.887243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:08:52.887243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:08:52.887243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIKfFnOn-7pa9f1ufRyIPtNjsifiqW7GmphisuoWeDsBSti08QBYd9PlVHAnSmvLyE0U9RslxaPullDXgIkXCupG8QfNyARf5wQS0xVK4zqihiw5sqrHF0onJ_in0wqkuouUWgqWaL-h6DqGMzHzykj3cOGPP5Boz0k1rE1vZd34Yw Jul 05 16:08:52.887243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:08:52.887243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:08:52.887243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:08:52.887243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:08:52.887243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:08:52.887243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:08:52.887243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: aba0375144644b01b15fb971eaf8b184 Jul 05 16:08:52.887243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-902415469 Jul 05 16:08:52.887243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:08:52.887243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:08:52.893815 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_aba0375144644b01b15fb971eaf8b184"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/aba0375144644b01b15fb971eaf8b184"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/aba0375144644b01b15fb971eaf8b184"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/aba0375144644b01b15fb971eaf8b184"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:08:52.893815 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-VolumesSnapshotsTestJSON-902415469 Jul 05 16:08:52.893815 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: aba0375144644b01b15fb971eaf8b184 Jul 05 16:08:52.893815 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-902415469 Jul 05 16:08:52.893815 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-VolumesSnapshotsTestJSON-902415469-project Jul 05 16:08:52.893815 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:08:52.893815 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:08:52.893815 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: b2497e2db101402e80478eac693d8953 Jul 05 16:08:52.893815 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-VolumesSnapshotsTestJSON-902415469-project Jul 05 16:08:52.893815 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: Jul 05 16:08:52.893815 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Snapshot ed98bab6-ea65-4031-af0d-1d0be54e8d04 could not be found. Jul 05 16:08:52.893815 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': 'ed98bab6-ea65-4031-af0d-1d0be54e8d04'} Jul 05 16:08:52.893815 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:08:52.894861 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:52.894861 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 05 16:08:52.894861 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 05 16:08:52.894861 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 05 16:08:52.894861 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 05 16:08:52.894861 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 05 16:08:52.894861 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 05 16:08:52.894861 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 16:08:52.894861 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 16:08:52.894861 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 16:08:52.894861 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 16:08:52.894861 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 16:08:52.894861 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 16:08:52.894861 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 16:08:52.894861 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 16:08:52.894861 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ed98bab6-ea65-4031-af0d-1d0be54e8d04 could not be found. (HTTP 404) (Request-ID: req-b0ccebb7-ff07-47b2-aef0-0615813cf16c) Jul 05 16:08:52.894861 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:52.894861 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:08:52.895931 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:52.895931 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:52.895931 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 05 16:08:52.895931 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 05 16:08:52.895931 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 05 16:08:52.895931 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 05 16:08:52.895931 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 05 16:08:52.895931 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 05 16:08:52.895931 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 05 16:08:52.895931 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 16:08:52.895931 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 05 16:08:52.895931 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 05 16:08:52.895931 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 05 16:08:52.895931 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 05 16:08:52.895931 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 05 16:08:52.895931 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 05 16:08:52.895931 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 16:08:52.895931 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 16:08:52.895931 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 16:08:52.897204 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 16:08:52.897204 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 16:08:52.897204 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 16:08:52.897204 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 16:08:52.897204 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 16:08:52.897204 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ed98bab6-ea65-4031-af0d-1d0be54e8d04 could not be found. Jul 05 16:08:52.897204 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:52.897204 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:08:52.897204 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:52.897204 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:52.897204 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:08:52.897204 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:08:52.897204 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:08:52.897204 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:08:52.897204 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 16:08:52.897204 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 16:08:52.897204 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:08:52.897204 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:08:52.897204 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 05 16:08:52.897204 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:08:52.899366 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ed98bab6-ea65-4031-af0d-1d0be54e8d04 could not be found. Jul 05 16:08:52.899366 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:52.899366 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:08:52.899366 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:52.899366 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:52.899366 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:08:52.899366 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:08:52.899366 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:08:52.899366 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:08:52.899366 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ed98bab6-ea65-4031-af0d-1d0be54e8d04 could not be found. Jul 05 16:08:52.899366 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:52.899366 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-5fb4c7b0-d961-47ee-b9de-91dc102163ee tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] Returning 404 to user: Snapshot ed98bab6-ea65-4031-af0d-1d0be54e8d04 could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:08:52.899366 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-5fb4c7b0-d961-47ee-b9de-91dc102163ee tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/ed98bab6-ea65-4031-af0d-1d0be54e8d04" status: 404 len: 111 microversion: 2.1 time: 0.045468 Jul 05 16:08:52.899366 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 15/22] 10.222.0.45 () {58 vars in 1250 bytes} [Tue Jul 5 16:08:52 2022] GET /compute/v2.1/os-snapshots/ed98bab6-ea65-4031-af0d-1d0be54e8d04 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 16:08:52.904424 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-dd41727b-180a-4724-8dc6-5925cc42f5d8 tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] Calling method '.version_select at 0x7f3095d74dc0>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:08:53.226398 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-dd41727b-180a-4724-8dc6-5925cc42f5d8 tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/6b29b225-1884-4c07-bcec-f4415f2942f6" status: 202 len: 0 microversion: 2.1 time: 0.322268 Jul 05 16:08:53.232173 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 8/23] 10.222.0.45 () {58 vars in 1247 bytes} [Tue Jul 5 16:08:52 2022] DELETE /compute/v2.1/os-volumes/6b29b225-1884-4c07-bcec-f4415f2942f6 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 16:08:53.233096 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-fae400f4-2d34-429e-bb3e-8f1560f3db7d tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] Calling method '.version_select at 0x7f3095d03790>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:08:53.328749 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-fae400f4-2d34-429e-bb3e-8f1560f3db7d tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/6b29b225-1884-4c07-bcec-f4415f2942f6" status: 200 len: 344 microversion: 2.1 time: 0.100351 Jul 05 16:08:53.329751 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 16/24] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Jul 5 16:08:53 2022] GET /compute/v2.1/os-volumes/6b29b225-1884-4c07-bcec-f4415f2942f6 => generated 344 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:08:54.343233 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-196c2510-3d27-40f1-b796-655f4c39fc1b tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] Calling method '.version_select at 0x7f3095d74310>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:08:54.400438 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.wsgi [None req-196c2510-3d27-40f1-b796-655f4c39fc1b tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] HTTP exception thrown: Volume 6b29b225-1884-4c07-bcec-f4415f2942f6 could not be found. Jul 05 16:08:54.405406 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-196c2510-3d27-40f1-b796-655f4c39fc1b tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] Request method failure captured: Jul 05 16:08:54.405406 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: request: GET /compute/v2.1/os-volumes/6b29b225-1884-4c07-bcec-f4415f2942f6 HTTP/1.1 Jul 05 16:08:54.405406 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Accept: application/json Jul 05 16:08:54.405406 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Accept-Encoding: identity Jul 05 16:08:54.405406 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Connection: close Jul 05 16:08:54.405406 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Content-Length: 0 Jul 05 16:08:54.405406 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Content-Type: application/json Jul 05 16:08:54.405406 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Host: 10.222.0.45 Jul 05 16:08:54.405406 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Openstack-System-Scope: None Jul 05 16:08:54.405406 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: User-Agent: python-urllib3/1.26.9 Jul 05 16:08:54.405406 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Auth-Token: gAAAAABixGIKfFnOn-7pa9f1ufRyIPtNjsifiqW7GmphisuoWeDsBSti08QBYd9PlVHAnSmvLyE0U9RslxaPullDXgIkXCupG8QfNyARf5wQS0xVK4zqihiw5sqrHF0onJ_in0wqkuouUWgqWaL-h6DqGMzHzykj3cOGPP5Boz0k1rE1vZd34Yw Jul 05 16:08:54.405406 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Domain-Id: None Jul 05 16:08:54.405406 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Domain-Name: None Jul 05 16:08:54.405406 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Identity-Status: Confirmed Jul 05 16:08:54.405406 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Is-Admin-Project: True Jul 05 16:08:54.405406 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Domain-Id: default Jul 05 16:08:54.405406 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Domain-Name: Default Jul 05 16:08:54.405406 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Id: aba0375144644b01b15fb971eaf8b184 Jul 05 16:08:54.405406 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-902415469 Jul 05 16:08:54.405406 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Role: reader,member Jul 05 16:08:54.405406 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Roles: reader,member Jul 05 16:08:54.406464 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_aba0375144644b01b15fb971eaf8b184"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/aba0375144644b01b15fb971eaf8b184"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/aba0375144644b01b15fb971eaf8b184"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/aba0375144644b01b15fb971eaf8b184"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:08:54.406464 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Tenant: tempest-VolumesSnapshotsTestJSON-902415469 Jul 05 16:08:54.406464 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Tenant-Id: aba0375144644b01b15fb971eaf8b184 Jul 05 16:08:54.406464 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-902415469 Jul 05 16:08:54.406464 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User: tempest-VolumesSnapshotsTestJSON-902415469-project Jul 05 16:08:54.406464 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Domain-Id: default Jul 05 16:08:54.406464 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Domain-Name: Default Jul 05 16:08:54.406464 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Id: b2497e2db101402e80478eac693d8953 Jul 05 16:08:54.406464 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Name: tempest-VolumesSnapshotsTestJSON-902415469-project Jul 05 16:08:54.406464 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: method: Jul 05 16:08:54.406464 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: exception: Volume 6b29b225-1884-4c07-bcec-f4415f2942f6 could not be found. Jul 05 16:08:54.406464 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: action_args: {'id': '6b29b225-1884-4c07-bcec-f4415f2942f6'} Jul 05 16:08:54.406464 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:08:54.407077 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:54.407077 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 16:08:54.407077 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 16:08:54.407077 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 05 16:08:54.407077 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 05 16:08:54.407077 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 05 16:08:54.407077 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 05 16:08:54.407077 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 16:08:54.407077 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 16:08:54.407077 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 16:08:54.407077 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 16:08:54.407077 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 16:08:54.407077 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 16:08:54.407077 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 16:08:54.407077 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 16:08:54.407077 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6b29b225-1884-4c07-bcec-f4415f2942f6 could not be found. (HTTP 404) (Request-ID: req-e46e3d72-7c9e-4f29-9691-489502a30a5d) Jul 05 16:08:54.407077 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:08:54.407077 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:08:54.407077 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:08:54.407984 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:54.407984 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 05 16:08:54.407984 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 05 16:08:54.407984 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 05 16:08:54.407984 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 05 16:08:54.407984 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 05 16:08:54.407984 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 05 16:08:54.407984 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 05 16:08:54.407984 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 16:08:54.407984 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 16:08:54.407984 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 16:08:54.407984 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 05 16:08:54.407984 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 05 16:08:54.407984 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 05 16:08:54.407984 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 05 16:08:54.407984 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 16:08:54.407984 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 16:08:54.407984 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 16:08:54.407984 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 16:08:54.408863 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 16:08:54.408863 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 16:08:54.408863 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 16:08:54.408863 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 16:08:54.408863 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6b29b225-1884-4c07-bcec-f4415f2942f6 could not be found. Jul 05 16:08:54.408863 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:08:54.408863 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:08:54.408863 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:08:54.408863 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:54.408863 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:08:54.408863 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:08:54.408863 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:08:54.408863 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:08:54.408863 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 16:08:54.408863 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 16:08:54.408863 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:08:54.408863 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:08:54.408863 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 05 16:08:54.408863 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:08:54.409707 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6b29b225-1884-4c07-bcec-f4415f2942f6 could not be found. Jul 05 16:08:54.409707 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:08:54.409707 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:08:54.409707 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:08:54.409707 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:54.409707 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:08:54.409707 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:08:54.409707 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:08:54.409707 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:08:54.409707 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6b29b225-1884-4c07-bcec-f4415f2942f6 could not be found. Jul 05 16:08:54.409707 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:08:54.412667 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-196c2510-3d27-40f1-b796-655f4c39fc1b tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] Returning 404 to user: Volume 6b29b225-1884-4c07-bcec-f4415f2942f6 could not be found. {{(pid=118319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:08:54.418201 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-196c2510-3d27-40f1-b796-655f4c39fc1b tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/6b29b225-1884-4c07-bcec-f4415f2942f6" status: 404 len: 109 microversion: 2.1 time: 0.076490 Jul 05 16:08:54.426060 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-9c929544-1f47-4392-92eb-3bdfe75cdb53 tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] Calling method '.version_select at 0x7f3095d03430>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:08:54.433836 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 9/25] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Jul 5 16:08:54 2022] GET /compute/v2.1/os-volumes/6b29b225-1884-4c07-bcec-f4415f2942f6 => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 16:08:54.481250 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-9c929544-1f47-4392-92eb-3bdfe75cdb53 tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] HTTP exception thrown: Volume 6b29b225-1884-4c07-bcec-f4415f2942f6 could not be found. Jul 05 16:08:54.483450 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-9c929544-1f47-4392-92eb-3bdfe75cdb53 tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] Request method failure captured: Jul 05 16:08:54.483450 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: DELETE /compute/v2.1/os-volumes/6b29b225-1884-4c07-bcec-f4415f2942f6 HTTP/1.1 Jul 05 16:08:54.483450 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:08:54.483450 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:08:54.483450 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:08:54.483450 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:08:54.483450 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:08:54.483450 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:08:54.483450 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:08:54.483450 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:08:54.483450 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIKfFnOn-7pa9f1ufRyIPtNjsifiqW7GmphisuoWeDsBSti08QBYd9PlVHAnSmvLyE0U9RslxaPullDXgIkXCupG8QfNyARf5wQS0xVK4zqihiw5sqrHF0onJ_in0wqkuouUWgqWaL-h6DqGMzHzykj3cOGPP5Boz0k1rE1vZd34Yw Jul 05 16:08:54.483450 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:08:54.483450 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:08:54.483450 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:08:54.483450 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:08:54.483450 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:08:54.483450 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:08:54.483450 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: aba0375144644b01b15fb971eaf8b184 Jul 05 16:08:54.483450 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-902415469 Jul 05 16:08:54.483450 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:08:54.483450 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:08:54.489339 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_aba0375144644b01b15fb971eaf8b184"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/aba0375144644b01b15fb971eaf8b184"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/aba0375144644b01b15fb971eaf8b184"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/aba0375144644b01b15fb971eaf8b184"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:08:54.489339 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-VolumesSnapshotsTestJSON-902415469 Jul 05 16:08:54.489339 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: aba0375144644b01b15fb971eaf8b184 Jul 05 16:08:54.489339 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-902415469 Jul 05 16:08:54.489339 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-VolumesSnapshotsTestJSON-902415469-project Jul 05 16:08:54.489339 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:08:54.489339 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:08:54.489339 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: b2497e2db101402e80478eac693d8953 Jul 05 16:08:54.489339 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-VolumesSnapshotsTestJSON-902415469-project Jul 05 16:08:54.489339 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: Jul 05 16:08:54.489339 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Volume 6b29b225-1884-4c07-bcec-f4415f2942f6 could not be found. Jul 05 16:08:54.489339 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': '6b29b225-1884-4c07-bcec-f4415f2942f6'} Jul 05 16:08:54.489339 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:08:54.489948 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:54.489948 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 16:08:54.489948 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 16:08:54.489948 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 05 16:08:54.489948 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 05 16:08:54.489948 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 05 16:08:54.489948 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 05 16:08:54.489948 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 05 16:08:54.489948 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 05 16:08:54.489948 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 05 16:08:54.489948 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 05 16:08:54.489948 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 16:08:54.489948 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 16:08:54.489948 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 16:08:54.489948 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 16:08:54.489948 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6b29b225-1884-4c07-bcec-f4415f2942f6 could not be found. (HTTP 404) (Request-ID: req-654883a0-d591-4a51-95d2-46a9dee50b13) Jul 05 16:08:54.489948 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:54.489948 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:08:54.489948 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:54.491091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:54.491091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 05 16:08:54.491091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 05 16:08:54.491091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 05 16:08:54.491091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 05 16:08:54.491091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 05 16:08:54.491091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 05 16:08:54.491091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 05 16:08:54.491091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 16:08:54.491091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 16:08:54.491091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 16:08:54.491091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 05 16:08:54.491091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 05 16:08:54.491091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 05 16:08:54.491091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 05 16:08:54.491091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 05 16:08:54.491091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 05 16:08:54.491091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 05 16:08:54.491091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 05 16:08:54.509458 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 16:08:54.509458 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 16:08:54.509458 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 16:08:54.509458 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 16:08:54.509458 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6b29b225-1884-4c07-bcec-f4415f2942f6 could not be found. Jul 05 16:08:54.509458 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:54.509458 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:08:54.509458 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:54.509458 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:54.509458 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:08:54.509458 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:08:54.509458 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:08:54.509458 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:08:54.509458 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 16:08:54.509458 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 16:08:54.509458 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:08:54.509458 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:08:54.509458 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 05 16:08:54.509458 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:08:54.510386 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6b29b225-1884-4c07-bcec-f4415f2942f6 could not be found. Jul 05 16:08:54.510386 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:54.510386 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:08:54.510386 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:54.510386 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:54.510386 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:08:54.510386 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:08:54.510386 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:08:54.510386 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:08:54.510386 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6b29b225-1884-4c07-bcec-f4415f2942f6 could not be found. Jul 05 16:08:54.510386 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:08:54.510386 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-9c929544-1f47-4392-92eb-3bdfe75cdb53 tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] Returning 404 to user: Volume 6b29b225-1884-4c07-bcec-f4415f2942f6 could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:08:54.510386 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-9c929544-1f47-4392-92eb-3bdfe75cdb53 tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/6b29b225-1884-4c07-bcec-f4415f2942f6" status: 404 len: 109 microversion: 2.1 time: 0.073575 Jul 05 16:08:54.510386 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 17/26] 10.222.0.45 () {58 vars in 1247 bytes} [Tue Jul 5 16:08:54 2022] DELETE /compute/v2.1/os-volumes/6b29b225-1884-4c07-bcec-f4415f2942f6 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 16:08:54.511240 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-2647e6f6-e12d-410c-9471-e0be40756859 tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] Calling method '.version_select at 0x7f3095cf7040>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:08:54.573831 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.wsgi [None req-2647e6f6-e12d-410c-9471-e0be40756859 tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] HTTP exception thrown: Volume 6b29b225-1884-4c07-bcec-f4415f2942f6 could not be found. Jul 05 16:08:54.576939 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-2647e6f6-e12d-410c-9471-e0be40756859 tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] Request method failure captured: Jul 05 16:08:54.576939 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: request: GET /compute/v2.1/os-volumes/6b29b225-1884-4c07-bcec-f4415f2942f6 HTTP/1.1 Jul 05 16:08:54.576939 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Accept: application/json Jul 05 16:08:54.576939 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Accept-Encoding: identity Jul 05 16:08:54.576939 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Connection: close Jul 05 16:08:54.576939 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Content-Length: 0 Jul 05 16:08:54.576939 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Content-Type: application/json Jul 05 16:08:54.576939 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Host: 10.222.0.45 Jul 05 16:08:54.576939 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Openstack-System-Scope: None Jul 05 16:08:54.576939 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: User-Agent: python-urllib3/1.26.9 Jul 05 16:08:54.576939 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Auth-Token: gAAAAABixGIKfFnOn-7pa9f1ufRyIPtNjsifiqW7GmphisuoWeDsBSti08QBYd9PlVHAnSmvLyE0U9RslxaPullDXgIkXCupG8QfNyARf5wQS0xVK4zqihiw5sqrHF0onJ_in0wqkuouUWgqWaL-h6DqGMzHzykj3cOGPP5Boz0k1rE1vZd34Yw Jul 05 16:08:54.576939 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Domain-Id: None Jul 05 16:08:54.576939 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Domain-Name: None Jul 05 16:08:54.576939 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Identity-Status: Confirmed Jul 05 16:08:54.576939 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Is-Admin-Project: True Jul 05 16:08:54.576939 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Domain-Id: default Jul 05 16:08:54.576939 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Domain-Name: Default Jul 05 16:08:54.576939 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Id: aba0375144644b01b15fb971eaf8b184 Jul 05 16:08:54.576939 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-902415469 Jul 05 16:08:54.576939 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Role: reader,member Jul 05 16:08:54.576939 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Roles: reader,member Jul 05 16:08:54.577969 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_aba0375144644b01b15fb971eaf8b184"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/aba0375144644b01b15fb971eaf8b184"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/aba0375144644b01b15fb971eaf8b184"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/aba0375144644b01b15fb971eaf8b184"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:08:54.577969 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Tenant: tempest-VolumesSnapshotsTestJSON-902415469 Jul 05 16:08:54.577969 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Tenant-Id: aba0375144644b01b15fb971eaf8b184 Jul 05 16:08:54.577969 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-902415469 Jul 05 16:08:54.577969 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User: tempest-VolumesSnapshotsTestJSON-902415469-project Jul 05 16:08:54.577969 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Domain-Id: default Jul 05 16:08:54.577969 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Domain-Name: Default Jul 05 16:08:54.577969 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Id: b2497e2db101402e80478eac693d8953 Jul 05 16:08:54.577969 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Name: tempest-VolumesSnapshotsTestJSON-902415469-project Jul 05 16:08:54.577969 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: method: Jul 05 16:08:54.577969 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: exception: Volume 6b29b225-1884-4c07-bcec-f4415f2942f6 could not be found. Jul 05 16:08:54.577969 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: action_args: {'id': '6b29b225-1884-4c07-bcec-f4415f2942f6'} Jul 05 16:08:54.577969 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:08:54.578580 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:54.578580 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 16:08:54.578580 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 16:08:54.578580 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 05 16:08:54.578580 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 05 16:08:54.578580 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 05 16:08:54.578580 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 05 16:08:54.578580 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 16:08:54.578580 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 16:08:54.578580 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 16:08:54.578580 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 16:08:54.578580 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 16:08:54.578580 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 16:08:54.578580 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 16:08:54.578580 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 16:08:54.578580 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6b29b225-1884-4c07-bcec-f4415f2942f6 could not be found. (HTTP 404) (Request-ID: req-5c529642-3b53-4278-b8b7-7c0b8e8e29bb) Jul 05 16:08:54.578580 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:08:54.578580 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:08:54.578580 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:08:54.579435 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:54.579435 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 05 16:08:54.579435 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 05 16:08:54.579435 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 05 16:08:54.579435 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 05 16:08:54.579435 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 05 16:08:54.579435 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 05 16:08:54.579435 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 05 16:08:54.579435 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 16:08:54.579435 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 16:08:54.579435 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 16:08:54.579435 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 05 16:08:54.579435 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 05 16:08:54.579435 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 05 16:08:54.579435 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 05 16:08:54.579435 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 16:08:54.579435 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 16:08:54.579435 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 16:08:54.579435 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 16:08:54.580262 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 16:08:54.580262 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 16:08:54.580262 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 16:08:54.580262 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 16:08:54.580262 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6b29b225-1884-4c07-bcec-f4415f2942f6 could not be found. Jul 05 16:08:54.580262 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:08:54.580262 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:08:54.580262 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:08:54.580262 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:54.580262 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:08:54.580262 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:08:54.580262 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:08:54.580262 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:08:54.580262 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 16:08:54.580262 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 16:08:54.580262 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:08:54.580262 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:08:54.580262 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 05 16:08:54.580262 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:08:54.581114 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6b29b225-1884-4c07-bcec-f4415f2942f6 could not be found. Jul 05 16:08:54.581114 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:08:54.581114 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:08:54.581114 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:08:54.581114 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:08:54.581114 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:08:54.581114 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:08:54.581114 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:08:54.581114 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:08:54.581114 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6b29b225-1884-4c07-bcec-f4415f2942f6 could not be found. Jul 05 16:08:54.581114 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:08:54.581114 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-2647e6f6-e12d-410c-9471-e0be40756859 tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] Returning 404 to user: Volume 6b29b225-1884-4c07-bcec-f4415f2942f6 could not be found. {{(pid=118319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:08:54.581114 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-2647e6f6-e12d-410c-9471-e0be40756859 tempest-VolumesSnapshotsTestJSON-902415469 tempest-VolumesSnapshotsTestJSON-902415469-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/6b29b225-1884-4c07-bcec-f4415f2942f6" status: 404 len: 109 microversion: 2.1 time: 0.078846 Jul 05 16:08:54.581114 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 10/27] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Jul 5 16:08:54 2022] GET /compute/v2.1/os-volumes/6b29b225-1884-4c07-bcec-f4415f2942f6 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 16:08:56.413814 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-d41ffd8a-ba6d-48a9-b301-6f44e1d420e3 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Action: 'create', calling method: .version_select at 0x7f3095d03af0>, body: {"keypair": {"name": "tempest-keypair-1765971067", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnFQvk1wCWX4HLBMWT4i1DUGAGtkLS5bbYeVANugr32ie3gfzr80OHwwA1F3wTym6MtXI5E0MEd5V36NCEpBcXM9fbEnOr0BT5ZACuT89B2Ymd3LFdjypjASZhQz3hoFg=="}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:08:56.533165 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-d41ffd8a-ba6d-48a9-b301-6f44e1d420e3 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Getting quotas for project 3ec37a457530439b8728dd2ad2b6b7bd. Resources: {'key_pairs'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:08:56.545911 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-d41ffd8a-ba6d-48a9-b301-6f44e1d420e3 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Getting quotas for user d7e2fc1ec676438392d7925b43b806f5 and project 3ec37a457530439b8728dd2ad2b6b7bd. Resources: {'key_pairs'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:08:56.769833 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-d41ffd8a-ba6d-48a9-b301-6f44e1d420e3 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.667276 Jul 05 16:08:56.776719 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 18/28] 10.222.0.45 () {60 vars in 1158 bytes} [Tue Jul 5 16:08:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:08:57.843243 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-51634ac8-f152-4329-9247-6c85db8f6823 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1470904691", "imageRef": "c5805086-2ebd-4742-8185-f79894fef91e", "flavorRef": "452", "networks": [{"uuid": "7440bb30-cbe1-4a38-83c5-7b7fcf3eea20"}]}} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:08:58.072381 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.network.neutron [None req-51634ac8-f152-4329-9247-6c85db8f6823 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] validate_networks() for [('7440bb30-cbe1-4a38-83c5-7b7fcf3eea20', None, None, None, None, None)] {{(pid=118319) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 16:09:00.089561 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-51634ac8-f152-4329-9247-6c85db8f6823 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Flavor limits 0:0:0 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 16:09:00.090644 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-51634ac8-f152-4329-9247-6c85db8f6823 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Image limits 0:0:0 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 16:09:00.091316 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-51634ac8-f152-4329-9247-6c85db8f6823 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Flavor pref 0:0:0 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 16:09:00.092034 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-51634ac8-f152-4329-9247-6c85db8f6823 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Image pref 0:0:0 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 16:09:00.092619 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-51634ac8-f152-4329-9247-6c85db8f6823 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 16:09:00.144970 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-51634ac8-f152-4329-9247-6c85db8f6823 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:00.146557 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-51634ac8-f152-4329-9247-6c85db8f6823 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:00.148083 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-51634ac8-f152-4329-9247-6c85db8f6823 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:00.150249 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-51634ac8-f152-4329-9247-6c85db8f6823 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:00.222359 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.quota [None req-51634ac8-f152-4329-9247-6c85db8f6823 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Getting quotas for project ba872aaf0fd84b1eac87e18659d222d5. Resources: {'ram', 'instances', 'cores'} {{(pid=118319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:09:00.231677 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.quota [None req-51634ac8-f152-4329-9247-6c85db8f6823 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Getting quotas for user d89990bfd774417ab0eb52b91ec560d8 and project ba872aaf0fd84b1eac87e18659d222d5. Resources: {'ram', 'instances', 'cores'} {{(pid=118319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:09:00.247370 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-51634ac8-f152-4329-9247-6c85db8f6823 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Going to run 1 instances... {{(pid=118319) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 16:09:00.252653 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-51634ac8-f152-4329-9247-6c85db8f6823 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5805086-2ebd-4742-8185-f79894fef91e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 16:09:00.294682 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-136f8066-69f1-4137-bd0c-8d7be020a85f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Action: 'create', calling method: .version_select at 0x7f3095c7c3a0>, body: {"keypair": {"name": "tempest-keypair-387427874", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPv+macujbkvN58KQDXmHo7Qd6rohT02MKWT7Y3cLzJNyx3IoBmGeCNW3cnWVOyZU6abRStrtt7iLrZ3hmSVbD9CkjKHErLl/rjSfBCokJlFFJnQdbLt/5iBhegkDUhHw=="}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:09:00.348742 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-136f8066-69f1-4137-bd0c-8d7be020a85f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Getting quotas for project b6acb89542314578839f701251add904. Resources: {'key_pairs'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:09:00.383399 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-136f8066-69f1-4137-bd0c-8d7be020a85f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Getting quotas for user cb0474d4e6dd4d2b9918fd0ebe803dcd and project b6acb89542314578839f701251add904. Resources: {'key_pairs'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:09:00.589436 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-136f8066-69f1-4137-bd0c-8d7be020a85f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.607290 Jul 05 16:09:00.590499 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 19/29] 10.222.0.45 () {62 vars in 1199 bytes} [Tue Jul 5 16:08:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 612 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 05 16:09:00.687613 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-51634ac8-f152-4329-9247-6c85db8f6823 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.965752 Jul 05 16:09:00.688304 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 11/30] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Jul 5 16:08:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 16:09:01.715762 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-54fd299f-edb9-4793-911b-e596929d0731 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-676618513", "imageRef": "c5805086-2ebd-4742-8185-f79894fef91e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:09:01.754975 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-2114cc30-ebd3-46ec-9212-74b310f716a7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Action: 'create', calling method: .version_select at 0x7f30953f9160>, body: {"keypair": {"name": "tempest-keypair-1131890633", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4A219nt6ts1ESLjDa5Fc0LWLd3RsZSuSGXVAkaykmLVBY8tcuRWf4YnLYSL56Ju2MDDvayZcCBbiPUUe04TqXRd3uRf7eD2CKBqdUx9rwk95zSp+KYmjd+G2I815vVUQ=="}} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:09:01.863871 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.quota [None req-2114cc30-ebd3-46ec-9212-74b310f716a7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Getting quotas for project 42e6ad67dbf542528726c545872ac10c. Resources: {'key_pairs'} {{(pid=118319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:09:01.886688 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.quota [None req-2114cc30-ebd3-46ec-9212-74b310f716a7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Getting quotas for user 0c8512e7c1704fac9cc4fcfe3bf1f18b and project 42e6ad67dbf542528726c545872ac10c. Resources: {'key_pairs'} {{(pid=118319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:09:01.996028 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.network.neutron [None req-54fd299f-edb9-4793-911b-e596929d0731 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] validate_networks() for [('d875afbf-ed35-412f-bb5d-c579562ff61a', None, None, None, None, None)] {{(pid=118320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 16:09:02.110937 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-2114cc30-ebd3-46ec-9212-74b310f716a7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.420945 Jul 05 16:09:02.113353 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 12/31] 10.222.0.45 () {60 vars in 1158 bytes} [Tue Jul 5 16:09:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:09:02.122216 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-c83f31b3-4c31-484b-9118-638000d8e017 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:02.123169 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-c83f31b3-4c31-484b-9118-638000d8e017 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:02.664851 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-c83f31b3-4c31-484b-9118-638000d8e017 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89990bfd774417ab0eb52b91ec560d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba872aaf0fd84b1eac87e18659d222d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:02.702454 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-c83f31b3-4c31-484b-9118-638000d8e017 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 200 len: 1215 microversion: 2.1 time: 0.587660 Jul 05 16:09:02.716255 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 13/32] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:02 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 1215 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:03.216709 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-78a86a4b-1b36-4aeb-bded-bb33e5c307c6 tempest-VolumesGetTestJSON-887124811 tempest-VolumesGetTestJSON-887124811-project] Action: 'create', calling method: .version_select at 0x7f30943a6820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2020399705", "metadata": {"Type": "work"}}} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:09:04.408581 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-54fd299f-edb9-4793-911b-e596929d0731 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Flavor limits 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 16:09:04.409093 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-54fd299f-edb9-4793-911b-e596929d0731 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Image limits 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 16:09:04.409576 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-54fd299f-edb9-4793-911b-e596929d0731 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Flavor pref 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 16:09:04.409989 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-54fd299f-edb9-4793-911b-e596929d0731 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Image pref 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 16:09:04.410495 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-54fd299f-edb9-4793-911b-e596929d0731 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 16:09:04.434044 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-54fd299f-edb9-4793-911b-e596929d0731 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:04.438069 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-54fd299f-edb9-4793-911b-e596929d0731 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:04.439307 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-54fd299f-edb9-4793-911b-e596929d0731 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:04.439973 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-54fd299f-edb9-4793-911b-e596929d0731 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:04.504030 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-54fd299f-edb9-4793-911b-e596929d0731 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Getting quotas for project bbe6a2de3cba4aa7b365f30f5b2f745c. Resources: {'ram', 'instances', 'cores'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:09:04.517011 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-54fd299f-edb9-4793-911b-e596929d0731 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Getting quotas for user 8b6e665914774eabba120e986e6bb282 and project bbe6a2de3cba4aa7b365f30f5b2f745c. Resources: {'ram', 'instances', 'cores'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:09:04.541920 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-78a86a4b-1b36-4aeb-bded-bb33e5c307c6 tempest-VolumesGetTestJSON-887124811 tempest-VolumesGetTestJSON-887124811-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.823531 Jul 05 16:09:04.542948 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 14/33] 10.222.0.45 () {60 vars in 1155 bytes} [Tue Jul 5 16:09:02 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1826 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 05 16:09:04.557346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-54fd299f-edb9-4793-911b-e596929d0731 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Going to run 1 instances... {{(pid=118320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 16:09:04.561277 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-54fd299f-edb9-4793-911b-e596929d0731 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5805086-2ebd-4742-8185-f79894fef91e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 16:09:04.563543 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-20202ecb-3e2f-4011-bcce-ab672e61d8ee tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:04.564177 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-20202ecb-3e2f-4011-bcce-ab672e61d8ee tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:04.597310 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-20202ecb-3e2f-4011-bcce-ab672e61d8ee tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:04.598762 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-20202ecb-3e2f-4011-bcce-ab672e61d8ee tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:04.600161 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-20202ecb-3e2f-4011-bcce-ab672e61d8ee tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:04.600890 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-20202ecb-3e2f-4011-bcce-ab672e61d8ee tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:04.789816 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-54fd299f-edb9-4793-911b-e596929d0731 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.197980 Jul 05 16:09:04.798895 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 20/34] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Jul 5 16:09:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 4208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 16:09:04.811226 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-9feeb9a2-cdf8-431a-82b6-53bf502a1ffa tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-791195009", "imageRef": "c5805086-2ebd-4742-8185-f79894fef91e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "77e226ae-740f-49bf-a51d-1fc557b375c9"}], "security_groups": [{"name": "tempest-securitygroup--809250486"}], "key_name": "tempest-keypair-1765971067", "user_data": "}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:09:04.903367 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-20202ecb-3e2f-4011-bcce-ab672e61d8ee tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89990bfd774417ab0eb52b91ec560d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba872aaf0fd84b1eac87e18659d222d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:04.947061 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-20202ecb-3e2f-4011-bcce-ab672e61d8ee tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 200 len: 1219 microversion: 2.1 time: 0.400797 Jul 05 16:09:04.949057 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 15/35] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:04 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 1219 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:04.976027 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-7c530b63-a7e6-43fb-9740-84e7fe0b132d tempest-VolumesGetTestJSON-887124811 tempest-VolumesGetTestJSON-887124811-project] Calling method '.version_select at 0x7f309434c1f0>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:05.067720 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-7c530b63-a7e6-43fb-9740-84e7fe0b132d tempest-VolumesGetTestJSON-887124811 tempest-VolumesGetTestJSON-887124811-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/374ce62f-6b00-448e-99ec-22ff55d8ecdc" status: 200 len: 353 microversion: 2.1 time: 0.117281 Jul 05 16:09:05.073965 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 16/36] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Jul 5 16:09:04 2022] GET /compute/v2.1/os-volumes/374ce62f-6b00-448e-99ec-22ff55d8ecdc => generated 353 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:09:05.078898 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-747067d9-336b-472a-9137-6701b54c2689 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:05.079539 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-747067d9-336b-472a-9137-6701b54c2689 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:05.090623 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.network.neutron [None req-9feeb9a2-cdf8-431a-82b6-53bf502a1ffa tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] validate_networks() for [('77e226ae-740f-49bf-a51d-1fc557b375c9', None, None, None, None, None)] {{(pid=118320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 16:09:05.179472 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-747067d9-336b-472a-9137-6701b54c2689 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:05.190693 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-747067d9-336b-472a-9137-6701b54c2689 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1221 microversion: 2.1 time: 0.114745 Jul 05 16:09:05.190693 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 17/37] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:05 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1221 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:05.355132 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-f8510d9b-b875-454b-b828-81064d0efc13 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-103429411", "imageRef": "c5805086-2ebd-4742-8185-f79894fef91e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:09:05.558163 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.network.neutron [None req-f8510d9b-b875-454b-b828-81064d0efc13 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] validate_networks() for [('d875afbf-ed35-412f-bb5d-c579562ff61a', None, None, None, None, None)] {{(pid=118319) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 16:09:07.064060 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-9feeb9a2-cdf8-431a-82b6-53bf502a1ffa tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Flavor limits 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 16:09:07.064536 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-9feeb9a2-cdf8-431a-82b6-53bf502a1ffa tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Image limits 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 16:09:07.065027 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-9feeb9a2-cdf8-431a-82b6-53bf502a1ffa tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Flavor pref 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 16:09:07.065605 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-9feeb9a2-cdf8-431a-82b6-53bf502a1ffa tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Image pref 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 16:09:07.066165 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-9feeb9a2-cdf8-431a-82b6-53bf502a1ffa tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 16:09:07.084186 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9feeb9a2-cdf8-431a-82b6-53bf502a1ffa tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:07.087172 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9feeb9a2-cdf8-431a-82b6-53bf502a1ffa tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:07.090754 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9feeb9a2-cdf8-431a-82b6-53bf502a1ffa tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:07.091565 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9feeb9a2-cdf8-431a-82b6-53bf502a1ffa tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:07.165042 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-9feeb9a2-cdf8-431a-82b6-53bf502a1ffa tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Getting quotas for project 3ec37a457530439b8728dd2ad2b6b7bd. Resources: {'ram', 'instances', 'cores'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:09:07.175330 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-9feeb9a2-cdf8-431a-82b6-53bf502a1ffa tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Getting quotas for user d7e2fc1ec676438392d7925b43b806f5 and project 3ec37a457530439b8728dd2ad2b6b7bd. Resources: {'ram', 'instances', 'cores'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:09:07.246503 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-9feeb9a2-cdf8-431a-82b6-53bf502a1ffa tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Going to run 1 instances... {{(pid=118320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 16:09:07.257284 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-9feeb9a2-cdf8-431a-82b6-53bf502a1ffa tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5805086-2ebd-4742-8185-f79894fef91e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 16:09:07.403953 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-9feeb9a2-cdf8-431a-82b6-53bf502a1ffa tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.603464 Jul 05 16:09:07.404609 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 21/38] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Jul 5 16:09:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 2605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 16:09:07.413691 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-28357039-48d1-47f5-b377-f37799513e0b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1937653549", "imageRef": "c5805086-2ebd-4742-8185-f79894fef91e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2110daf5-1cfa-4c9d-9065-b33fabf55a66"}], "security_groups": [{"name": "tempest-securitygroup--463631035"}], "key_name": "tempest-keypair-387427874", "user_data": "}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:09:08.050068 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-f8510d9b-b875-454b-b828-81064d0efc13 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Flavor limits 0:0:0 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 16:09:08.051989 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-f8510d9b-b875-454b-b828-81064d0efc13 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Image limits 0:0:0 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 16:09:08.052719 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-f8510d9b-b875-454b-b828-81064d0efc13 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Flavor pref 0:0:0 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 16:09:08.053346 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-f8510d9b-b875-454b-b828-81064d0efc13 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Image pref 0:0:0 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 16:09:08.054177 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-f8510d9b-b875-454b-b828-81064d0efc13 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 16:09:08.064562 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.network.neutron [None req-28357039-48d1-47f5-b377-f37799513e0b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] validate_networks() for [('2110daf5-1cfa-4c9d-9065-b33fabf55a66', None, None, None, None, None)] {{(pid=118320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 16:09:08.080486 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f8510d9b-b875-454b-b828-81064d0efc13 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:08.086159 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f8510d9b-b875-454b-b828-81064d0efc13 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:08.087386 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f8510d9b-b875-454b-b828-81064d0efc13 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:08.091152 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f8510d9b-b875-454b-b828-81064d0efc13 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:08.146256 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.quota [None req-f8510d9b-b875-454b-b828-81064d0efc13 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Getting quotas for project bbe6a2de3cba4aa7b365f30f5b2f745c. Resources: {'ram', 'instances', 'cores'} {{(pid=118319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:09:08.167541 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.quota [None req-f8510d9b-b875-454b-b828-81064d0efc13 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Getting quotas for user 8b6e665914774eabba120e986e6bb282 and project bbe6a2de3cba4aa7b365f30f5b2f745c. Resources: {'ram', 'instances', 'cores'} {{(pid=118319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:09:08.242351 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-f8510d9b-b875-454b-b828-81064d0efc13 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Going to run 1 instances... {{(pid=118319) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 16:09:08.246390 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-f8510d9b-b875-454b-b828-81064d0efc13 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5805086-2ebd-4742-8185-f79894fef91e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 16:09:08.539580 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-f8510d9b-b875-454b-b828-81064d0efc13 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.191527 Jul 05 16:09:08.548928 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 18/39] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Jul 5 16:09:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 3202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 05 16:09:08.558911 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-86a65ac9-b4ea-46ff-853c-5da0b16cbe8a tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:08.564329 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-86a65ac9-b4ea-46ff-853c-5da0b16cbe8a tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:08.583899 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-86a65ac9-b4ea-46ff-853c-5da0b16cbe8a tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:08.585584 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-86a65ac9-b4ea-46ff-853c-5da0b16cbe8a tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:08.587057 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-86a65ac9-b4ea-46ff-853c-5da0b16cbe8a tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:08.589244 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-86a65ac9-b4ea-46ff-853c-5da0b16cbe8a tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:08.978900 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-86a65ac9-b4ea-46ff-853c-5da0b16cbe8a tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89990bfd774417ab0eb52b91ec560d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba872aaf0fd84b1eac87e18659d222d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:08.988354 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-86a65ac9-b4ea-46ff-853c-5da0b16cbe8a tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 200 len: 1273 microversion: 2.1 time: 0.438050 Jul 05 16:09:08.989780 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 19/40] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:08 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 1273 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:08.995101 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-fc220072-5fb9-4a51-91b2-6f8def337bc4 tempest-VolumesGetTestJSON-887124811 tempest-VolumesGetTestJSON-887124811-project] Calling method '.version_select at 0x7f3094306670>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:09.224645 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-fc220072-5fb9-4a51-91b2-6f8def337bc4 tempest-VolumesGetTestJSON-887124811 tempest-VolumesGetTestJSON-887124811-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/374ce62f-6b00-448e-99ec-22ff55d8ecdc" status: 200 len: 354 microversion: 2.1 time: 0.232874 Jul 05 16:09:09.231540 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 20/41] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Jul 5 16:09:08 2022] GET /compute/v2.1/os-volumes/374ce62f-6b00-448e-99ec-22ff55d8ecdc => generated 354 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:09:09.237742 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-c0e8f4ea-e8b6-4dd1-a3fb-96cd3c6d5d8c tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:09.238370 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-c0e8f4ea-e8b6-4dd1-a3fb-96cd3c6d5d8c tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:09.258909 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c0e8f4ea-e8b6-4dd1-a3fb-96cd3c6d5d8c tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:09.259395 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c0e8f4ea-e8b6-4dd1-a3fb-96cd3c6d5d8c tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:09.260242 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c0e8f4ea-e8b6-4dd1-a3fb-96cd3c6d5d8c tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:09.260688 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c0e8f4ea-e8b6-4dd1-a3fb-96cd3c6d5d8c tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:09.413379 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-c0e8f4ea-e8b6-4dd1-a3fb-96cd3c6d5d8c tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:09.426719 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-c0e8f4ea-e8b6-4dd1-a3fb-96cd3c6d5d8c tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1241 microversion: 2.1 time: 0.193336 Jul 05 16:09:09.427614 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 21/42] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:09 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1241 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:09.441009 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-aef7e8a4-c6f7-4bb9-8192-761a8fa19dc9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:09.442057 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-aef7e8a4-c6f7-4bb9-8192-761a8fa19dc9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:09.573340 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-aef7e8a4-c6f7-4bb9-8192-761a8fa19dc9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:09.585075 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-aef7e8a4-c6f7-4bb9-8192-761a8fa19dc9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1221 microversion: 2.1 time: 0.151211 Jul 05 16:09:09.593473 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 22/43] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:09 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1221 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:09.606358 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-648cb3de-b260-4d56-9629-a2e39192cfa1 tempest-VolumesGetTestJSON-887124811 tempest-VolumesGetTestJSON-887124811-project] Calling method '.version_select at 0x7f3094317550>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:09.906205 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-648cb3de-b260-4d56-9629-a2e39192cfa1 tempest-VolumesGetTestJSON-887124811 tempest-VolumesGetTestJSON-887124811-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/374ce62f-6b00-448e-99ec-22ff55d8ecdc" status: 200 len: 354 microversion: 2.1 time: 0.311557 Jul 05 16:09:09.906833 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 23/44] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Jul 5 16:09:09 2022] GET /compute/v2.1/os-volumes/374ce62f-6b00-448e-99ec-22ff55d8ecdc => generated 354 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:09:09.929208 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-bebd41cc-4006-487b-bc3f-20926c962c4a tempest-VolumesGetTestJSON-887124811 tempest-VolumesGetTestJSON-887124811-project] Calling method '.version_select at 0x7f3094317d30>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:10.317111 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-28357039-48d1-47f5-b377-f37799513e0b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Flavor limits 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 16:09:10.317795 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-bebd41cc-4006-487b-bc3f-20926c962c4a tempest-VolumesGetTestJSON-887124811 tempest-VolumesGetTestJSON-887124811-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/374ce62f-6b00-448e-99ec-22ff55d8ecdc" status: 202 len: 0 microversion: 2.1 time: 0.393388 Jul 05 16:09:10.318253 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-28357039-48d1-47f5-b377-f37799513e0b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Image limits 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 16:09:10.318321 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 24/45] 10.222.0.45 () {58 vars in 1247 bytes} [Tue Jul 5 16:09:09 2022] DELETE /compute/v2.1/os-volumes/374ce62f-6b00-448e-99ec-22ff55d8ecdc => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 16:09:10.318397 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-28357039-48d1-47f5-b377-f37799513e0b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Flavor pref 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 16:09:10.318397 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-28357039-48d1-47f5-b377-f37799513e0b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Image pref 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 16:09:10.318397 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-28357039-48d1-47f5-b377-f37799513e0b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 16:09:10.324921 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-8bad5810-3d64-44f9-9b13-2fd0ec17a8ed tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:10.325691 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-8bad5810-3d64-44f9-9b13-2fd0ec17a8ed tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:10.331719 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-28357039-48d1-47f5-b377-f37799513e0b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:10.334077 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-28357039-48d1-47f5-b377-f37799513e0b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:10.335985 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-28357039-48d1-47f5-b377-f37799513e0b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:10.338394 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-28357039-48d1-47f5-b377-f37799513e0b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:10.362790 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8bad5810-3d64-44f9-9b13-2fd0ec17a8ed tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:10.363913 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8bad5810-3d64-44f9-9b13-2fd0ec17a8ed tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:10.366448 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8bad5810-3d64-44f9-9b13-2fd0ec17a8ed tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:10.369439 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8bad5810-3d64-44f9-9b13-2fd0ec17a8ed tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:10.425009 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-28357039-48d1-47f5-b377-f37799513e0b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Getting quotas for project b6acb89542314578839f701251add904. Resources: {'ram', 'instances', 'cores'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:09:10.442899 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-28357039-48d1-47f5-b377-f37799513e0b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Getting quotas for user cb0474d4e6dd4d2b9918fd0ebe803dcd and project b6acb89542314578839f701251add904. Resources: {'ram', 'instances', 'cores'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:09:10.485343 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-28357039-48d1-47f5-b377-f37799513e0b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Going to run 1 instances... {{(pid=118320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 16:09:10.499790 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-28357039-48d1-47f5-b377-f37799513e0b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5805086-2ebd-4742-8185-f79894fef91e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 16:09:10.784440 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-8bad5810-3d64-44f9-9b13-2fd0ec17a8ed tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89990bfd774417ab0eb52b91ec560d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba872aaf0fd84b1eac87e18659d222d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:10.792700 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-28357039-48d1-47f5-b377-f37799513e0b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.386815 Jul 05 16:09:10.797824 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 22/46] 10.222.0.45 () {62 vars in 1187 bytes} [Tue Jul 5 16:09:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 3392 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 05 16:09:10.806817 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-8bad5810-3d64-44f9-9b13-2fd0ec17a8ed tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 200 len: 1315 microversion: 2.1 time: 0.485693 Jul 05 16:09:10.819092 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 25/47] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:10 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:10.827450 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-dddb0a1a-c11b-4391-941d-85b363e274f0 tempest-VolumesGetTestJSON-887124811 tempest-VolumesGetTestJSON-887124811-project] Calling method '.version_select at 0x7f30953c6040>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:10.830306 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-144d64d4-3d68-40bd-8999-4ef5a8e8dfdb tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:10.835059 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-144d64d4-3d68-40bd-8999-4ef5a8e8dfdb tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:10.843941 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-144d64d4-3d68-40bd-8999-4ef5a8e8dfdb tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:10.844672 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-144d64d4-3d68-40bd-8999-4ef5a8e8dfdb tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:10.848621 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-144d64d4-3d68-40bd-8999-4ef5a8e8dfdb tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:10.848621 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-144d64d4-3d68-40bd-8999-4ef5a8e8dfdb tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:11.020435 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-144d64d4-3d68-40bd-8999-4ef5a8e8dfdb tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:11.030506 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-144d64d4-3d68-40bd-8999-4ef5a8e8dfdb tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1289 microversion: 2.1 time: 0.210071 Jul 05 16:09:11.040189 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 26/48] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:10 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1289 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:11.060177 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-dddb0a1a-c11b-4391-941d-85b363e274f0 tempest-VolumesGetTestJSON-887124811 tempest-VolumesGetTestJSON-887124811-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/374ce62f-6b00-448e-99ec-22ff55d8ecdc" status: 200 len: 353 microversion: 2.1 time: 0.243733 Jul 05 16:09:11.065388 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-59b96bfd-f39b-437f-99c6-851fe232e043 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:11.065388 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-59b96bfd-f39b-437f-99c6-851fe232e043 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:11.065754 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 23/49] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Jul 5 16:09:10 2022] GET /compute/v2.1/os-volumes/374ce62f-6b00-448e-99ec-22ff55d8ecdc => generated 353 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:09:11.071258 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-25570c62-4ffd-4ffc-a9f8-5eefb121f3b2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:11.073274 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-25570c62-4ffd-4ffc-a9f8-5eefb121f3b2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:11.076134 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-59b96bfd-f39b-437f-99c6-851fe232e043 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:11.076823 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-59b96bfd-f39b-437f-99c6-851fe232e043 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:11.077960 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-59b96bfd-f39b-437f-99c6-851fe232e043 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:11.078554 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-59b96bfd-f39b-437f-99c6-851fe232e043 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:11.294326 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-59b96bfd-f39b-437f-99c6-851fe232e043 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:11.294326 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-59b96bfd-f39b-437f-99c6-851fe232e043 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1217 microversion: 2.1 time: 0.211740 Jul 05 16:09:11.294326 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 27/50] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:11 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1217 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:11.295089 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-51741d09-a1b1-407c-8d12-cd890276962d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-414749716", "imageRef": "c5805086-2ebd-4742-8185-f79894fef91e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "77ec7356-4bd9-42af-abe3-f1b9c525bdef"}], "security_groups": [{"name": "tempest-securitygroup--1080684529"}], "key_name": "tempest-keypair-1131890633", "user_data": "}} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:09:11.356576 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-25570c62-4ffd-4ffc-a9f8-5eefb121f3b2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:11.407671 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-25570c62-4ffd-4ffc-a9f8-5eefb121f3b2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:11.415140 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-25570c62-4ffd-4ffc-a9f8-5eefb121f3b2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:11.416988 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-25570c62-4ffd-4ffc-a9f8-5eefb121f3b2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1281 microversion: 2.20 time: 0.352263 Jul 05 16:09:11.436485 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 24/51] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:09:11 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1281 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:09:11.457064 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.network.neutron [None req-51741d09-a1b1-407c-8d12-cd890276962d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] validate_networks() for [('77ec7356-4bd9-42af-abe3-f1b9c525bdef', None, None, None, None, None)] {{(pid=118319) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 16:09:11.825795 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-c7c506ba-44e7-4fc7-b4e7-e895524c9d69 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:11.826739 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-c7c506ba-44e7-4fc7-b4e7-e895524c9d69 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:11.866711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c7c506ba-44e7-4fc7-b4e7-e895524c9d69 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:11.867190 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c7c506ba-44e7-4fc7-b4e7-e895524c9d69 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:11.871311 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c7c506ba-44e7-4fc7-b4e7-e895524c9d69 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:11.872997 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c7c506ba-44e7-4fc7-b4e7-e895524c9d69 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:11.929473 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-51741d09-a1b1-407c-8d12-cd890276962d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Flavor limits 0:0:0 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 16:09:11.930122 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-51741d09-a1b1-407c-8d12-cd890276962d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Image limits 0:0:0 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 16:09:11.931990 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-51741d09-a1b1-407c-8d12-cd890276962d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Flavor pref 0:0:0 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 16:09:11.932415 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-51741d09-a1b1-407c-8d12-cd890276962d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Image pref 0:0:0 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 16:09:11.933758 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-51741d09-a1b1-407c-8d12-cd890276962d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 16:09:11.956880 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-51741d09-a1b1-407c-8d12-cd890276962d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:11.957330 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-51741d09-a1b1-407c-8d12-cd890276962d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:11.958615 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-51741d09-a1b1-407c-8d12-cd890276962d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:11.959997 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-51741d09-a1b1-407c-8d12-cd890276962d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:12.018789 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.quota [None req-51741d09-a1b1-407c-8d12-cd890276962d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Getting quotas for project 42e6ad67dbf542528726c545872ac10c. Resources: {'ram', 'instances', 'cores'} {{(pid=118319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:09:12.044699 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.quota [None req-51741d09-a1b1-407c-8d12-cd890276962d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Getting quotas for user 0c8512e7c1704fac9cc4fcfe3bf1f18b and project 42e6ad67dbf542528726c545872ac10c. Resources: {'ram', 'instances', 'cores'} {{(pid=118319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:09:12.059485 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-51741d09-a1b1-407c-8d12-cd890276962d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Going to run 1 instances... {{(pid=118319) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 16:09:12.070604 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-51741d09-a1b1-407c-8d12-cd890276962d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5805086-2ebd-4742-8185-f79894fef91e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 16:09:12.281922 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c7c506ba-44e7-4fc7-b4e7-e895524c9d69 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89990bfd774417ab0eb52b91ec560d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba872aaf0fd84b1eac87e18659d222d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:12.295867 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-c7c506ba-44e7-4fc7-b4e7-e895524c9d69 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 200 len: 1315 microversion: 2.1 time: 0.474190 Jul 05 16:09:12.296280 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-51741d09-a1b1-407c-8d12-cd890276962d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.031178 Jul 05 16:09:12.296723 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 25/52] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:11 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:12.307114 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-e5848f60-8045-42a1-b2bb-10c61f775f89 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:12.310895 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-e5848f60-8045-42a1-b2bb-10c61f775f89 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:12.318356 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 28/53] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Jul 5 16:09:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 1054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 16:09:12.324149 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-4a998fc9-2bb9-456c-a19a-5c95ff2ee926 tempest-VolumesGetTestJSON-887124811 tempest-VolumesGetTestJSON-887124811-project] Calling method '.version_select at 0x7f30943170d0>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:12.324365 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e5848f60-8045-42a1-b2bb-10c61f775f89 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:12.324970 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e5848f60-8045-42a1-b2bb-10c61f775f89 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:12.330641 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e5848f60-8045-42a1-b2bb-10c61f775f89 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:12.330641 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e5848f60-8045-42a1-b2bb-10c61f775f89 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:12.429653 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-e5848f60-8045-42a1-b2bb-10c61f775f89 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:12.439428 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-e5848f60-8045-42a1-b2bb-10c61f775f89 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1289 microversion: 2.1 time: 0.141390 Jul 05 16:09:12.441207 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 26/54] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:12 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1289 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:12.449569 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-32b6c1a4-ae80-488f-84a1-4f69679cd1d9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:12.450129 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-32b6c1a4-ae80-488f-84a1-4f69679cd1d9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:12.465262 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-32b6c1a4-ae80-488f-84a1-4f69679cd1d9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:12.465913 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-32b6c1a4-ae80-488f-84a1-4f69679cd1d9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:12.467220 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-32b6c1a4-ae80-488f-84a1-4f69679cd1d9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:12.467748 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-32b6c1a4-ae80-488f-84a1-4f69679cd1d9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:12.473847 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-4a998fc9-2bb9-456c-a19a-5c95ff2ee926 tempest-VolumesGetTestJSON-887124811 tempest-VolumesGetTestJSON-887124811-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/374ce62f-6b00-448e-99ec-22ff55d8ecdc" status: 200 len: 353 microversion: 2.1 time: 0.153547 Jul 05 16:09:12.476405 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 29/55] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Jul 5 16:09:12 2022] GET /compute/v2.1/os-volumes/374ce62f-6b00-448e-99ec-22ff55d8ecdc => generated 353 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:09:12.490072 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-d770d27f-1fcb-475d-b3f3-fb4227bb7edf tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:12.492701 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-d770d27f-1fcb-475d-b3f3-fb4227bb7edf tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:12.548145 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-32b6c1a4-ae80-488f-84a1-4f69679cd1d9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:12.558546 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-32b6c1a4-ae80-488f-84a1-4f69679cd1d9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1217 microversion: 2.1 time: 0.115777 Jul 05 16:09:12.567741 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 27/56] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:12 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1217 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:12.587965 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-c37acfc0-70ac-4a5d-8f10-71c29c5b907f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:12.592553 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-c37acfc0-70ac-4a5d-8f10-71c29c5b907f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:12.633706 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-d770d27f-1fcb-475d-b3f3-fb4227bb7edf tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:12.649578 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-d770d27f-1fcb-475d-b3f3-fb4227bb7edf tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1241 microversion: 2.1 time: 0.171237 Jul 05 16:09:12.660978 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 30/57] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:12 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1241 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:12.666678 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c37acfc0-70ac-4a5d-8f10-71c29c5b907f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:12.675026 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c37acfc0-70ac-4a5d-8f10-71c29c5b907f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:12.677167 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c37acfc0-70ac-4a5d-8f10-71c29c5b907f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:12.678962 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-c37acfc0-70ac-4a5d-8f10-71c29c5b907f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1281 microversion: 2.20 time: 0.109893 Jul 05 16:09:12.679710 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 28/58] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:09:12 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1281 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:09:13.313189 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-ad4d5829-c1bf-460b-a2a5-a17e98bb601f tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:13.313820 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-ad4d5829-c1bf-460b-a2a5-a17e98bb601f tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:13.323250 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ad4d5829-c1bf-460b-a2a5-a17e98bb601f tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:13.323250 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ad4d5829-c1bf-460b-a2a5-a17e98bb601f tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:13.323250 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ad4d5829-c1bf-460b-a2a5-a17e98bb601f tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:13.323250 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ad4d5829-c1bf-460b-a2a5-a17e98bb601f tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:13.460089 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-c2cf1efd-8261-4395-8627-c255d8df8da9 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:13.461508 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-c2cf1efd-8261-4395-8627-c255d8df8da9 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:13.490530 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-ad4d5829-c1bf-460b-a2a5-a17e98bb601f tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89990bfd774417ab0eb52b91ec560d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba872aaf0fd84b1eac87e18659d222d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:13.490530 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-ad4d5829-c1bf-460b-a2a5-a17e98bb601f tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 200 len: 1315 microversion: 2.1 time: 0.174565 Jul 05 16:09:13.490530 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 31/59] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:13 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:13.491087 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c2cf1efd-8261-4395-8627-c255d8df8da9 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:13.491087 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c2cf1efd-8261-4395-8627-c255d8df8da9 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:13.491309 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c2cf1efd-8261-4395-8627-c255d8df8da9 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:13.491434 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-3bc2b866-8f97-466e-a2dc-44053def3490 tempest-VolumesGetTestJSON-887124811 tempest-VolumesGetTestJSON-887124811-project] Calling method '.version_select at 0x7f3094306b80>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:13.491758 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c2cf1efd-8261-4395-8627-c255d8df8da9 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:13.562053 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-3bc2b866-8f97-466e-a2dc-44053def3490 tempest-VolumesGetTestJSON-887124811 tempest-VolumesGetTestJSON-887124811-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/374ce62f-6b00-448e-99ec-22ff55d8ecdc" status: 200 len: 353 microversion: 2.1 time: 0.075039 Jul 05 16:09:13.563218 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 32/60] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Jul 5 16:09:13 2022] GET /compute/v2.1/os-volumes/374ce62f-6b00-448e-99ec-22ff55d8ecdc => generated 353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:09:13.576399 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-ef1fbd8e-6b93-4a4a-a714-6292b9592370 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:13.578443 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-ef1fbd8e-6b93-4a4a-a714-6292b9592370 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:13.581321 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c2cf1efd-8261-4395-8627-c255d8df8da9 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:13.583753 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ef1fbd8e-6b93-4a4a-a714-6292b9592370 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:13.584861 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ef1fbd8e-6b93-4a4a-a714-6292b9592370 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:13.585797 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ef1fbd8e-6b93-4a4a-a714-6292b9592370 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:13.586389 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ef1fbd8e-6b93-4a4a-a714-6292b9592370 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:13.592223 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-c2cf1efd-8261-4395-8627-c255d8df8da9 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1289 microversion: 2.1 time: 0.137931 Jul 05 16:09:13.615463 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 29/61] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:13 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1289 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:09:13.670857 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-b7378b81-9e20-4c2a-9d69-e21d82a3a0fe tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:13.672730 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-b7378b81-9e20-4c2a-9d69-e21d82a3a0fe tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:13.689620 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b7378b81-9e20-4c2a-9d69-e21d82a3a0fe tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:13.690318 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b7378b81-9e20-4c2a-9d69-e21d82a3a0fe tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:13.691280 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b7378b81-9e20-4c2a-9d69-e21d82a3a0fe tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:13.692169 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b7378b81-9e20-4c2a-9d69-e21d82a3a0fe tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:13.739297 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-ef1fbd8e-6b93-4a4a-a714-6292b9592370 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:13.750148 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-ef1fbd8e-6b93-4a4a-a714-6292b9592370 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1217 microversion: 2.1 time: 0.178171 Jul 05 16:09:13.752500 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 33/62] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:13 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1217 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:09:13.758691 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-71100efb-0d8e-433f-bb27-a1c8b5b418a4 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:13.759652 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-71100efb-0d8e-433f-bb27-a1c8b5b418a4 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:13.786866 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-71100efb-0d8e-433f-bb27-a1c8b5b418a4 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:13.787388 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-71100efb-0d8e-433f-bb27-a1c8b5b418a4 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:13.788272 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-71100efb-0d8e-433f-bb27-a1c8b5b418a4 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:13.790880 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-71100efb-0d8e-433f-bb27-a1c8b5b418a4 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:13.798208 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-b7378b81-9e20-4c2a-9d69-e21d82a3a0fe tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:13.807927 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-b7378b81-9e20-4c2a-9d69-e21d82a3a0fe tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1245 microversion: 2.1 time: 0.142085 Jul 05 16:09:13.820736 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 30/63] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:13 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1245 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:13.878276 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-71100efb-0d8e-433f-bb27-a1c8b5b418a4 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:13.887818 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-71100efb-0d8e-433f-bb27-a1c8b5b418a4 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:13.897967 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-71100efb-0d8e-433f-bb27-a1c8b5b418a4 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:13.897967 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-71100efb-0d8e-433f-bb27-a1c8b5b418a4 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1285 microversion: 2.20 time: 0.137120 Jul 05 16:09:13.897967 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 34/64] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:09:13 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:09:14.505137 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-b741422c-b00c-44a2-a9ab-ff9b7d1ed3c3 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:14.505850 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-b741422c-b00c-44a2-a9ab-ff9b7d1ed3c3 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:14.539653 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b741422c-b00c-44a2-a9ab-ff9b7d1ed3c3 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:14.540126 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b741422c-b00c-44a2-a9ab-ff9b7d1ed3c3 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:14.540959 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b741422c-b00c-44a2-a9ab-ff9b7d1ed3c3 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:14.541449 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b741422c-b00c-44a2-a9ab-ff9b7d1ed3c3 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:14.576139 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-a38f90ba-4768-4134-96ff-393facc9d0f3 tempest-VolumesGetTestJSON-887124811 tempest-VolumesGetTestJSON-887124811-project] Calling method '.version_select at 0x7f30943175e0>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:14.694401 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.wsgi [None req-a38f90ba-4768-4134-96ff-393facc9d0f3 tempest-VolumesGetTestJSON-887124811 tempest-VolumesGetTestJSON-887124811-project] HTTP exception thrown: Volume 374ce62f-6b00-448e-99ec-22ff55d8ecdc could not be found. Jul 05 16:09:14.697362 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-a38f90ba-4768-4134-96ff-393facc9d0f3 tempest-VolumesGetTestJSON-887124811 tempest-VolumesGetTestJSON-887124811-project] Request method failure captured: Jul 05 16:09:14.697362 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: request: GET /compute/v2.1/os-volumes/374ce62f-6b00-448e-99ec-22ff55d8ecdc HTTP/1.1 Jul 05 16:09:14.697362 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Accept: application/json Jul 05 16:09:14.697362 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Accept-Encoding: identity Jul 05 16:09:14.697362 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Connection: close Jul 05 16:09:14.697362 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Content-Length: 0 Jul 05 16:09:14.697362 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Content-Type: application/json Jul 05 16:09:14.697362 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Host: 10.222.0.45 Jul 05 16:09:14.697362 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Openstack-System-Scope: None Jul 05 16:09:14.697362 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: User-Agent: python-urllib3/1.26.9 Jul 05 16:09:14.697362 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Auth-Token: gAAAAABixGIcoNmBZSsbHahVZrBeGwakedX2wkoY0CIc8sbS-qepit-eJUsP5EN7gkoJUdADqqKeW70LG29xqXs2VbU87_H717kcujEDfvewfkI5d4jiX4uLoTylXohPB0Wq75aVHlyllpvZJvuoVolVzjxnOqWxNtLGWYjzixWxXb0ZkYqtADM Jul 05 16:09:14.697362 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Domain-Id: None Jul 05 16:09:14.697362 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Domain-Name: None Jul 05 16:09:14.697362 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Identity-Status: Confirmed Jul 05 16:09:14.697362 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Is-Admin-Project: True Jul 05 16:09:14.697362 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Domain-Id: default Jul 05 16:09:14.697362 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Domain-Name: Default Jul 05 16:09:14.697362 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Id: 5f869af7abeb422e9200d378c8b02b78 Jul 05 16:09:14.697362 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Name: tempest-VolumesGetTestJSON-887124811 Jul 05 16:09:14.697362 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Role: reader,member Jul 05 16:09:14.697362 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Roles: reader,member Jul 05 16:09:14.698743 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5f869af7abeb422e9200d378c8b02b78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5f869af7abeb422e9200d378c8b02b78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5f869af7abeb422e9200d378c8b02b78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5f869af7abeb422e9200d378c8b02b78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:09:14.698743 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Tenant: tempest-VolumesGetTestJSON-887124811 Jul 05 16:09:14.698743 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Tenant-Id: 5f869af7abeb422e9200d378c8b02b78 Jul 05 16:09:14.698743 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Tenant-Name: tempest-VolumesGetTestJSON-887124811 Jul 05 16:09:14.698743 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User: tempest-VolumesGetTestJSON-887124811-project Jul 05 16:09:14.698743 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Domain-Id: default Jul 05 16:09:14.698743 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Domain-Name: Default Jul 05 16:09:14.698743 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Id: 619d9a25f2244269aeaff7b50a8957e4 Jul 05 16:09:14.698743 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Name: tempest-VolumesGetTestJSON-887124811-project Jul 05 16:09:14.698743 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: method: Jul 05 16:09:14.698743 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: exception: Volume 374ce62f-6b00-448e-99ec-22ff55d8ecdc could not be found. Jul 05 16:09:14.698743 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: action_args: {'id': '374ce62f-6b00-448e-99ec-22ff55d8ecdc'} Jul 05 16:09:14.698743 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:09:14.699578 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:09:14.699578 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 16:09:14.699578 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 16:09:14.699578 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 05 16:09:14.699578 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 05 16:09:14.699578 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 05 16:09:14.699578 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 05 16:09:14.699578 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 16:09:14.699578 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 16:09:14.699578 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 16:09:14.699578 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 16:09:14.699578 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 16:09:14.699578 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 16:09:14.699578 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 16:09:14.699578 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 16:09:14.699578 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 374ce62f-6b00-448e-99ec-22ff55d8ecdc could not be found. (HTTP 404) (Request-ID: req-d7ea291a-b710-4389-97a7-e212172923ed) Jul 05 16:09:14.699578 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:09:14.699578 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:09:14.699578 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:09:14.701487 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:09:14.701487 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 05 16:09:14.701487 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 05 16:09:14.701487 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 05 16:09:14.701487 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 05 16:09:14.701487 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 05 16:09:14.701487 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 05 16:09:14.701487 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 05 16:09:14.701487 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 16:09:14.701487 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 16:09:14.701487 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 16:09:14.701487 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 05 16:09:14.701487 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 05 16:09:14.701487 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 05 16:09:14.701487 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 05 16:09:14.701487 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 16:09:14.701487 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 16:09:14.701487 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 16:09:14.701487 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 16:09:14.702617 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 16:09:14.702617 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 16:09:14.702617 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 16:09:14.702617 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 16:09:14.702617 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 374ce62f-6b00-448e-99ec-22ff55d8ecdc could not be found. Jul 05 16:09:14.702617 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:09:14.702617 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:09:14.702617 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:09:14.702617 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:09:14.702617 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:09:14.702617 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:09:14.702617 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:09:14.702617 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:09:14.702617 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 16:09:14.702617 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 16:09:14.702617 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:09:14.702617 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:09:14.702617 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 05 16:09:14.702617 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:09:14.704243 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 374ce62f-6b00-448e-99ec-22ff55d8ecdc could not be found. Jul 05 16:09:14.704243 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:09:14.704243 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:09:14.704243 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:09:14.704243 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:09:14.704243 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:09:14.704243 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:09:14.704243 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:09:14.704243 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:09:14.704243 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 374ce62f-6b00-448e-99ec-22ff55d8ecdc could not be found. Jul 05 16:09:14.704243 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:09:14.704243 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-a38f90ba-4768-4134-96ff-393facc9d0f3 tempest-VolumesGetTestJSON-887124811 tempest-VolumesGetTestJSON-887124811-project] Returning 404 to user: Volume 374ce62f-6b00-448e-99ec-22ff55d8ecdc could not be found. {{(pid=118319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:09:14.704243 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-a38f90ba-4768-4134-96ff-393facc9d0f3 tempest-VolumesGetTestJSON-887124811 tempest-VolumesGetTestJSON-887124811-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/374ce62f-6b00-448e-99ec-22ff55d8ecdc" status: 404 len: 109 microversion: 2.1 time: 0.130357 Jul 05 16:09:14.706000 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 35/65] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Jul 5 16:09:14 2022] GET /compute/v2.1/os-volumes/374ce62f-6b00-448e-99ec-22ff55d8ecdc => generated 109 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 16:09:14.712475 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-f7c568b8-8a06-4268-a3bb-10377b63d60b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:14.713118 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-f7c568b8-8a06-4268-a3bb-10377b63d60b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:14.732564 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f7c568b8-8a06-4268-a3bb-10377b63d60b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:14.732564 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f7c568b8-8a06-4268-a3bb-10377b63d60b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:14.732564 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f7c568b8-8a06-4268-a3bb-10377b63d60b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:14.732564 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f7c568b8-8a06-4268-a3bb-10377b63d60b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:14.792115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-b741422c-b00c-44a2-a9ab-ff9b7d1ed3c3 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89990bfd774417ab0eb52b91ec560d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba872aaf0fd84b1eac87e18659d222d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:14.800186 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-b741422c-b00c-44a2-a9ab-ff9b7d1ed3c3 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 200 len: 1315 microversion: 2.1 time: 0.299126 Jul 05 16:09:14.800799 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 31/66] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:14 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:14.815593 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-29800c3e-ace4-4de7-8bc4-d1ecdb1af143 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:14.824902 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-29800c3e-ace4-4de7-8bc4-d1ecdb1af143 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:14.838042 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-29800c3e-ace4-4de7-8bc4-d1ecdb1af143 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:14.838824 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-29800c3e-ace4-4de7-8bc4-d1ecdb1af143 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:14.839800 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-29800c3e-ace4-4de7-8bc4-d1ecdb1af143 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:14.840540 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-29800c3e-ace4-4de7-8bc4-d1ecdb1af143 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:14.908108 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-f7c568b8-8a06-4268-a3bb-10377b63d60b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:14.945678 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-f7c568b8-8a06-4268-a3bb-10377b63d60b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1297 microversion: 2.1 time: 0.232257 Jul 05 16:09:14.945678 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 36/67] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:14 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1297 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:14.951133 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-f798ec6c-8c48-4263-9299-10fec8028ea1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:14.951989 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-f798ec6c-8c48-4263-9299-10fec8028ea1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:14.958584 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-29800c3e-ace4-4de7-8bc4-d1ecdb1af143 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:14.975389 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:09:14.976304 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-29800c3e-ace4-4de7-8bc4-d1ecdb1af143 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1217 microversion: 2.1 time: 0.167607 Jul 05 16:09:14.978341 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 32/68] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:14 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1217 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:14.983507 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f798ec6c-8c48-4263-9299-10fec8028ea1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:14.989602 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f798ec6c-8c48-4263-9299-10fec8028ea1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:14.990833 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f798ec6c-8c48-4263-9299-10fec8028ea1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:14.991263 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f798ec6c-8c48-4263-9299-10fec8028ea1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:14.992873 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-74447d70-a2f2-4a0d-9d22-bd3f40f63464 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:14.994168 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-74447d70-a2f2-4a0d-9d22-bd3f40f63464 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:15.004068 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:09:15.016518 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-74447d70-a2f2-4a0d-9d22-bd3f40f63464 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:15.017042 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-74447d70-a2f2-4a0d-9d22-bd3f40f63464 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:15.021135 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-74447d70-a2f2-4a0d-9d22-bd3f40f63464 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:15.023847 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-74447d70-a2f2-4a0d-9d22-bd3f40f63464 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:15.178042 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-74447d70-a2f2-4a0d-9d22-bd3f40f63464 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:15.189631 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-74447d70-a2f2-4a0d-9d22-bd3f40f63464 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:15.194848 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-74447d70-a2f2-4a0d-9d22-bd3f40f63464 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:15.195752 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-f798ec6c-8c48-4263-9299-10fec8028ea1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:15.196937 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-74447d70-a2f2-4a0d-9d22-bd3f40f63464 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1285 microversion: 2.20 time: 0.215946 Jul 05 16:09:15.205335 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-f798ec6c-8c48-4263-9299-10fec8028ea1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1245 microversion: 2.1 time: 0.260121 Jul 05 16:09:15.208844 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 33/69] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:09:14 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1285 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:09:15.219583 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 37/70] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:14 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1245 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:15.822315 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-c7f0393a-dcdb-4600-a81f-37ba5681e720 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:15.822315 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-c7f0393a-dcdb-4600-a81f-37ba5681e720 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:15.839595 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c7f0393a-dcdb-4600-a81f-37ba5681e720 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:15.840033 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c7f0393a-dcdb-4600-a81f-37ba5681e720 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:15.856043 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c7f0393a-dcdb-4600-a81f-37ba5681e720 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:15.856043 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c7f0393a-dcdb-4600-a81f-37ba5681e720 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:15.961811 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-e9fdbc17-d33b-4e16-9119-9c13302430e6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:15.962770 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-e9fdbc17-d33b-4e16-9119-9c13302430e6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:15.971562 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e9fdbc17-d33b-4e16-9119-9c13302430e6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:15.975847 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e9fdbc17-d33b-4e16-9119-9c13302430e6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:15.975966 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e9fdbc17-d33b-4e16-9119-9c13302430e6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:15.980535 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e9fdbc17-d33b-4e16-9119-9c13302430e6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:16.288758 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-e9fdbc17-d33b-4e16-9119-9c13302430e6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:16.301976 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-e9fdbc17-d33b-4e16-9119-9c13302430e6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1307 microversion: 2.1 time: 0.347552 Jul 05 16:09:16.310940 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 38/71] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:15 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1307 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:16.325275 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-b8694c1b-d373-490a-9098-e46876420bcd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:16.327179 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-b8694c1b-d373-490a-9098-e46876420bcd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:16.337404 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b8694c1b-d373-490a-9098-e46876420bcd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:16.337887 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b8694c1b-d373-490a-9098-e46876420bcd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:16.338661 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b8694c1b-d373-490a-9098-e46876420bcd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:16.339081 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b8694c1b-d373-490a-9098-e46876420bcd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:16.436496 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-b8694c1b-d373-490a-9098-e46876420bcd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:16.448188 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-b8694c1b-d373-490a-9098-e46876420bcd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1273 microversion: 2.1 time: 0.134032 Jul 05 16:09:16.452369 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 39/72] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:16 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1273 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:16.472653 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-cd8233eb-17ef-4716-8c9b-1996e968b099 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:16.472653 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-cd8233eb-17ef-4716-8c9b-1996e968b099 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:16.482589 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cd8233eb-17ef-4716-8c9b-1996e968b099 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:16.486532 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cd8233eb-17ef-4716-8c9b-1996e968b099 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:16.487783 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cd8233eb-17ef-4716-8c9b-1996e968b099 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:16.488413 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cd8233eb-17ef-4716-8c9b-1996e968b099 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:16.595270 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c7f0393a-dcdb-4600-a81f-37ba5681e720 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89990bfd774417ab0eb52b91ec560d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba872aaf0fd84b1eac87e18659d222d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:16.603357 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-c7f0393a-dcdb-4600-a81f-37ba5681e720 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 200 len: 1315 microversion: 2.1 time: 0.787702 Jul 05 16:09:16.608472 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 34/73] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:15 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 1315 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:16.629405 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-dae7499b-ce85-4018-bc2d-26a24a71c737 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:16.630713 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-dae7499b-ce85-4018-bc2d-26a24a71c737 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:16.653481 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dae7499b-ce85-4018-bc2d-26a24a71c737 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:16.654371 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dae7499b-ce85-4018-bc2d-26a24a71c737 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:16.659979 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dae7499b-ce85-4018-bc2d-26a24a71c737 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:16.660803 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dae7499b-ce85-4018-bc2d-26a24a71c737 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:17.026676 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-cd8233eb-17ef-4716-8c9b-1996e968b099 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:17.055163 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-cd8233eb-17ef-4716-8c9b-1996e968b099 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:17.063661 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-cd8233eb-17ef-4716-8c9b-1996e968b099 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:17.065609 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-cd8233eb-17ef-4716-8c9b-1996e968b099 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1333 microversion: 2.20 time: 0.609907 Jul 05 16:09:17.067197 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 40/74] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:09:16 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1333 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:09:17.124884 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-dae7499b-ce85-4018-bc2d-26a24a71c737 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:17.136594 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-dae7499b-ce85-4018-bc2d-26a24a71c737 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1293 microversion: 2.1 time: 0.526403 Jul 05 16:09:17.141039 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 35/75] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:16 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1293 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:17.332186 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-c72ae260-d915-49d5-a0b4-1936d720abc2 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:17.333212 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-c72ae260-d915-49d5-a0b4-1936d720abc2 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:17.360490 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c72ae260-d915-49d5-a0b4-1936d720abc2 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:17.361496 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c72ae260-d915-49d5-a0b4-1936d720abc2 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:17.363399 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c72ae260-d915-49d5-a0b4-1936d720abc2 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:17.364886 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c72ae260-d915-49d5-a0b4-1936d720abc2 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:17.479866 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-e5de409c-b5fe-47d5-a0bb-5b5619ce7d24 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:17.480845 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-c72ae260-d915-49d5-a0b4-1936d720abc2 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:17.481664 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-e5de409c-b5fe-47d5-a0bb-5b5619ce7d24 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:17.491027 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-c72ae260-d915-49d5-a0b4-1936d720abc2 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1295 microversion: 2.1 time: 0.163083 Jul 05 16:09:17.495721 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e5de409c-b5fe-47d5-a0bb-5b5619ce7d24 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:17.498599 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e5de409c-b5fe-47d5-a0bb-5b5619ce7d24 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:17.501539 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 41/76] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:17 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1295 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:17.510072 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e5de409c-b5fe-47d5-a0bb-5b5619ce7d24 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:17.510603 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e5de409c-b5fe-47d5-a0bb-5b5619ce7d24 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:17.624970 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-e5de409c-b5fe-47d5-a0bb-5b5619ce7d24 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:17.633429 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-9bb81203-d80b-4eaa-ab6a-e542a3322e83 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:17.633797 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-e5de409c-b5fe-47d5-a0bb-5b5619ce7d24 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1281 microversion: 2.1 time: 0.168428 Jul 05 16:09:17.634038 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-9bb81203-d80b-4eaa-ab6a-e542a3322e83 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:17.641384 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 36/77] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:17 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1281 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:09:17.644951 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9bb81203-d80b-4eaa-ab6a-e542a3322e83 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:17.646076 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9bb81203-d80b-4eaa-ab6a-e542a3322e83 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:17.648068 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9bb81203-d80b-4eaa-ab6a-e542a3322e83 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:17.649176 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9bb81203-d80b-4eaa-ab6a-e542a3322e83 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:17.683729 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell1:SELECT=100 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:09:17.918475 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-9bb81203-d80b-4eaa-ab6a-e542a3322e83 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89990bfd774417ab0eb52b91ec560d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba872aaf0fd84b1eac87e18659d222d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:17.936322 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-9bb81203-d80b-4eaa-ab6a-e542a3322e83 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 200 len: 1315 microversion: 2.1 time: 0.315420 Jul 05 16:09:17.937537 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 42/78] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:17 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:18.091383 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-ce7f7c48-2f6d-4ae9-ba2a-7ff4fe0e8e82 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:18.092007 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-ce7f7c48-2f6d-4ae9-ba2a-7ff4fe0e8e82 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:18.099593 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ce7f7c48-2f6d-4ae9-ba2a-7ff4fe0e8e82 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:18.102635 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ce7f7c48-2f6d-4ae9-ba2a-7ff4fe0e8e82 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:18.103714 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ce7f7c48-2f6d-4ae9-ba2a-7ff4fe0e8e82 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:18.105817 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ce7f7c48-2f6d-4ae9-ba2a-7ff4fe0e8e82 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:18.157180 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-14e58e61-a987-4229-a09b-1712b9b58f3a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:18.158833 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-14e58e61-a987-4229-a09b-1712b9b58f3a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:18.166103 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-14e58e61-a987-4229-a09b-1712b9b58f3a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:18.167052 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-14e58e61-a987-4229-a09b-1712b9b58f3a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:18.168108 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-14e58e61-a987-4229-a09b-1712b9b58f3a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:18.168826 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-14e58e61-a987-4229-a09b-1712b9b58f3a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:18.191421 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-ce7f7c48-2f6d-4ae9-ba2a-7ff4fe0e8e82 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:18.204396 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-ce7f7c48-2f6d-4ae9-ba2a-7ff4fe0e8e82 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:18.206289 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-ce7f7c48-2f6d-4ae9-ba2a-7ff4fe0e8e82 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:18.207772 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-ce7f7c48-2f6d-4ae9-ba2a-7ff4fe0e8e82 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1333 microversion: 2.20 time: 0.122426 Jul 05 16:09:18.208931 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 37/79] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:09:18 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1333 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:09:18.309168 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-14e58e61-a987-4229-a09b-1712b9b58f3a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:18.329535 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-14e58e61-a987-4229-a09b-1712b9b58f3a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1293 microversion: 2.1 time: 0.178984 Jul 05 16:09:18.340747 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 43/80] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:18 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1293 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:09:18.510288 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-fc6576e5-fd50-4eab-ae64-cd4d899f4950 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:18.511037 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-fc6576e5-fd50-4eab-ae64-cd4d899f4950 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:18.523333 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fc6576e5-fd50-4eab-ae64-cd4d899f4950 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:18.525751 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fc6576e5-fd50-4eab-ae64-cd4d899f4950 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:18.530154 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fc6576e5-fd50-4eab-ae64-cd4d899f4950 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:18.530951 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fc6576e5-fd50-4eab-ae64-cd4d899f4950 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:18.656673 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-9de78afc-3d5d-475e-ad61-07f5fcf95beb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:18.657412 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-9de78afc-3d5d-475e-ad61-07f5fcf95beb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:18.680533 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9de78afc-3d5d-475e-ad61-07f5fcf95beb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:18.680690 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9de78afc-3d5d-475e-ad61-07f5fcf95beb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:18.681525 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9de78afc-3d5d-475e-ad61-07f5fcf95beb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:18.681997 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9de78afc-3d5d-475e-ad61-07f5fcf95beb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:18.831945 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-9de78afc-3d5d-475e-ad61-07f5fcf95beb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:18.845146 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-9de78afc-3d5d-475e-ad61-07f5fcf95beb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1281 microversion: 2.1 time: 0.195301 Jul 05 16:09:18.845754 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 44/81] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:18 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1281 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:09:18.931495 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-fc6576e5-fd50-4eab-ae64-cd4d899f4950 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:18.946173 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-fc6576e5-fd50-4eab-ae64-cd4d899f4950 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1362 microversion: 2.1 time: 0.442112 Jul 05 16:09:18.965799 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-b533e702-4e57-4517-95aa-e1e20bb789ff tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:18.966440 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-b533e702-4e57-4517-95aa-e1e20bb789ff tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:18.968675 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 38/82] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:18 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1362 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:18.977875 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b533e702-4e57-4517-95aa-e1e20bb789ff tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:18.978603 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b533e702-4e57-4517-95aa-e1e20bb789ff tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:18.986101 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b533e702-4e57-4517-95aa-e1e20bb789ff tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:18.986793 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b533e702-4e57-4517-95aa-e1e20bb789ff tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:19.228036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-0599559d-77da-4a60-b0b9-6152ad14d272 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:19.229356 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-0599559d-77da-4a60-b0b9-6152ad14d272 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:19.239876 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0599559d-77da-4a60-b0b9-6152ad14d272 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:19.240349 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0599559d-77da-4a60-b0b9-6152ad14d272 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:19.241300 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-b533e702-4e57-4517-95aa-e1e20bb789ff tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89990bfd774417ab0eb52b91ec560d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba872aaf0fd84b1eac87e18659d222d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:19.241771 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0599559d-77da-4a60-b0b9-6152ad14d272 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:19.241771 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0599559d-77da-4a60-b0b9-6152ad14d272 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:19.251327 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-b533e702-4e57-4517-95aa-e1e20bb789ff tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 200 len: 1315 microversion: 2.1 time: 0.291643 Jul 05 16:09:19.256391 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 45/83] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:18 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:19.323350 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-0599559d-77da-4a60-b0b9-6152ad14d272 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:19.336742 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-0599559d-77da-4a60-b0b9-6152ad14d272 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:19.341502 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-0599559d-77da-4a60-b0b9-6152ad14d272 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:19.342856 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-0599559d-77da-4a60-b0b9-6152ad14d272 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1333 microversion: 2.20 time: 0.119868 Jul 05 16:09:19.343677 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 39/84] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:09:19 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1333 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:09:19.347579 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-2bdacdc9-b7ef-4036-a6c0-12de1ba3fe5c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:19.348198 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-2bdacdc9-b7ef-4036-a6c0-12de1ba3fe5c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:19.355246 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2bdacdc9-b7ef-4036-a6c0-12de1ba3fe5c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:19.355892 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2bdacdc9-b7ef-4036-a6c0-12de1ba3fe5c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:19.356890 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2bdacdc9-b7ef-4036-a6c0-12de1ba3fe5c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:19.357324 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2bdacdc9-b7ef-4036-a6c0-12de1ba3fe5c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:19.465145 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-2bdacdc9-b7ef-4036-a6c0-12de1ba3fe5c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:19.477592 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-2bdacdc9-b7ef-4036-a6c0-12de1ba3fe5c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1293 microversion: 2.1 time: 0.133750 Jul 05 16:09:19.478880 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 46/85] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:19 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1293 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:19.857416 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-fabdeff3-2719-41e3-adfb-b63966ad1b8c req-4730d5c1-ce97-4d4a-9dc3-0f5e144cf132 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57bf131c-eb9d-4831-90e4-078609e6ff06", "tag": "54940261-cd96-498a-aea6-233e2ce2bed9"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:09:19.863322 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-0d729702-d519-4071-962d-c1ff6249b463 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:19.863937 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-0d729702-d519-4071-962d-c1ff6249b463 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:19.872539 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-fabdeff3-2719-41e3-adfb-b63966ad1b8c req-4730d5c1-ce97-4d4a-9dc3-0f5e144cf132 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:19.873324 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-fabdeff3-2719-41e3-adfb-b63966ad1b8c req-4730d5c1-ce97-4d4a-9dc3-0f5e144cf132 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:19.874834 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0d729702-d519-4071-962d-c1ff6249b463 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:19.877166 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0d729702-d519-4071-962d-c1ff6249b463 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:19.877993 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0d729702-d519-4071-962d-c1ff6249b463 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:19.878462 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0d729702-d519-4071-962d-c1ff6249b463 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:19.900942 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-fabdeff3-2719-41e3-adfb-b63966ad1b8c req-4730d5c1-ce97-4d4a-9dc3-0f5e144cf132 service nova] Creating event network-changed:54940261-cd96-498a-aea6-233e2ce2bed9 for instance 57bf131c-eb9d-4831-90e4-078609e6ff06 on hv-cinder-84875 Jul 05 16:09:19.902394 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-fabdeff3-2719-41e3-adfb-b63966ad1b8c req-4730d5c1-ce97-4d4a-9dc3-0f5e144cf132 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118320) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 05 16:09:19.903919 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-afec1427-577e-48b9-9397-8ec159b15e4f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:19.905019 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-afec1427-577e-48b9-9397-8ec159b15e4f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:19.905829 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-afec1427-577e-48b9-9397-8ec159b15e4f None None] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:19.906448 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-afec1427-577e-48b9-9397-8ec159b15e4f None None] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:19.917556 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.compute.rpcapi [None req-afec1427-577e-48b9-9397-8ec159b15e4f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 05 16:09:19.919125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-afec1427-577e-48b9-9397-8ec159b15e4f None None] Releasing lock "compute-rpcapi-router" {{(pid=118320) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 05 16:09:19.940578 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-afec1427-577e-48b9-9397-8ec159b15e4f None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.259885 Jul 05 16:09:19.941246 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 40/86] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:09:19.968051 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-1bd495ff-69af-4a1f-9d22-a3f80d957b3b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:19.968717 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-1bd495ff-69af-4a1f-9d22-a3f80d957b3b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:19.976713 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1bd495ff-69af-4a1f-9d22-a3f80d957b3b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:19.977466 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1bd495ff-69af-4a1f-9d22-a3f80d957b3b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:19.978407 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1bd495ff-69af-4a1f-9d22-a3f80d957b3b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:19.979067 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1bd495ff-69af-4a1f-9d22-a3f80d957b3b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:20.009560 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-0d729702-d519-4071-962d-c1ff6249b463 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:20.017549 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-0d729702-d519-4071-962d-c1ff6249b463 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1281 microversion: 2.1 time: 0.158790 Jul 05 16:09:20.027870 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 47/87] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:19 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1281 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:09:20.135254 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-1bd495ff-69af-4a1f-9d22-a3f80d957b3b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:20.139865 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=100 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:09:20.159084 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-1bd495ff-69af-4a1f-9d22-a3f80d957b3b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1362 microversion: 2.1 time: 0.196782 Jul 05 16:09:20.159710 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 41/88] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:19 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:09:20.284999 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-9da3ea08-a658-4741-9029-33b08bbd6d8c tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:20.287566 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-9da3ea08-a658-4741-9029-33b08bbd6d8c tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:20.311203 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9da3ea08-a658-4741-9029-33b08bbd6d8c tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:20.312278 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9da3ea08-a658-4741-9029-33b08bbd6d8c tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:20.314180 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9da3ea08-a658-4741-9029-33b08bbd6d8c tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:20.314851 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9da3ea08-a658-4741-9029-33b08bbd6d8c tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:20.368851 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-7fef0700-e6d3-4f6f-b935-04a5aa415431 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:20.369425 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-7fef0700-e6d3-4f6f-b935-04a5aa415431 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:20.378730 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7fef0700-e6d3-4f6f-b935-04a5aa415431 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:20.379744 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7fef0700-e6d3-4f6f-b935-04a5aa415431 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:20.381767 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7fef0700-e6d3-4f6f-b935-04a5aa415431 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:20.382829 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7fef0700-e6d3-4f6f-b935-04a5aa415431 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:20.485610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-7fef0700-e6d3-4f6f-b935-04a5aa415431 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:20.504600 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-7fef0700-e6d3-4f6f-b935-04a5aa415431 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:20.506707 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-7fef0700-e6d3-4f6f-b935-04a5aa415431 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:20.507854 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-7fef0700-e6d3-4f6f-b935-04a5aa415431 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1333 microversion: 2.20 time: 0.147085 Jul 05 16:09:20.508416 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 42/89] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:09:20 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1333 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:09:20.510963 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-9da3ea08-a658-4741-9029-33b08bbd6d8c tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89990bfd774417ab0eb52b91ec560d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba872aaf0fd84b1eac87e18659d222d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:20.519775 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-47f0fe6d-2637-428d-9832-7475044e2d45 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:20.522068 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-47f0fe6d-2637-428d-9832-7475044e2d45 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:20.525183 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-9da3ea08-a658-4741-9029-33b08bbd6d8c tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 200 len: 1315 microversion: 2.1 time: 0.256139 Jul 05 16:09:20.526005 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 48/90] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:20 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:20.528594 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-47f0fe6d-2637-428d-9832-7475044e2d45 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:20.529150 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-47f0fe6d-2637-428d-9832-7475044e2d45 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:20.530078 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-47f0fe6d-2637-428d-9832-7475044e2d45 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:20.530900 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-47f0fe6d-2637-428d-9832-7475044e2d45 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:20.603220 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-47f0fe6d-2637-428d-9832-7475044e2d45 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:20.614423 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-47f0fe6d-2637-428d-9832-7475044e2d45 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1293 microversion: 2.1 time: 0.100828 Jul 05 16:09:20.619606 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 43/91] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:20 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1293 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:21.046958 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-b18ac8da-8029-46b1-b9d5-3a710d2a266c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:21.046958 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-b18ac8da-8029-46b1-b9d5-3a710d2a266c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:21.051642 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b18ac8da-8029-46b1-b9d5-3a710d2a266c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:21.052101 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b18ac8da-8029-46b1-b9d5-3a710d2a266c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:21.052978 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b18ac8da-8029-46b1-b9d5-3a710d2a266c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:21.053593 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b18ac8da-8029-46b1-b9d5-3a710d2a266c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:21.163952 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-b18ac8da-8029-46b1-b9d5-3a710d2a266c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:21.176824 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-b18ac8da-8029-46b1-b9d5-3a710d2a266c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1281 microversion: 2.1 time: 0.145097 Jul 05 16:09:21.182998 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-475b909a-dc1a-469a-838d-2e0ee51c5173 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:21.182998 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-475b909a-dc1a-469a-838d-2e0ee51c5173 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:21.186085 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-475b909a-dc1a-469a-838d-2e0ee51c5173 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:21.186409 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 49/92] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:21 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1281 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:21.189373 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-475b909a-dc1a-469a-838d-2e0ee51c5173 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:21.190399 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-475b909a-dc1a-469a-838d-2e0ee51c5173 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:21.191058 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-475b909a-dc1a-469a-838d-2e0ee51c5173 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:21.488573 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-475b909a-dc1a-469a-838d-2e0ee51c5173 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:21.497791 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-475b909a-dc1a-469a-838d-2e0ee51c5173 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1362 microversion: 2.1 time: 0.323639 Jul 05 16:09:21.499161 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 44/93] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:21 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1362 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:09:21.526688 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-078bf01c-6e46-4382-9329-c05d3f074a07 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:21.527315 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-078bf01c-6e46-4382-9329-c05d3f074a07 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:21.534568 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-078bf01c-6e46-4382-9329-c05d3f074a07 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:21.535641 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-078bf01c-6e46-4382-9329-c05d3f074a07 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:21.537275 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-078bf01c-6e46-4382-9329-c05d3f074a07 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:21.541428 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-078bf01c-6e46-4382-9329-c05d3f074a07 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:21.544310 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-77e9584f-cbb8-44b3-9388-05278354d218 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:21.546080 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-77e9584f-cbb8-44b3-9388-05278354d218 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:21.551797 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-77e9584f-cbb8-44b3-9388-05278354d218 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:21.552343 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-77e9584f-cbb8-44b3-9388-05278354d218 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:21.553895 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-77e9584f-cbb8-44b3-9388-05278354d218 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:21.554470 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-77e9584f-cbb8-44b3-9388-05278354d218 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:21.617311 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-078bf01c-6e46-4382-9329-c05d3f074a07 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:21.625750 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-078bf01c-6e46-4382-9329-c05d3f074a07 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:21.627403 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-078bf01c-6e46-4382-9329-c05d3f074a07 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:21.630354 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-078bf01c-6e46-4382-9329-c05d3f074a07 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1333 microversion: 2.20 time: 0.106422 Jul 05 16:09:21.631730 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 50/94] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:09:21 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1333 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:09:21.650151 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-ffa98ba3-d7aa-4765-a80c-bc727454d1df tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:21.651105 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-ffa98ba3-d7aa-4765-a80c-bc727454d1df tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:21.658761 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ffa98ba3-d7aa-4765-a80c-bc727454d1df tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:21.659730 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ffa98ba3-d7aa-4765-a80c-bc727454d1df tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:21.660721 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ffa98ba3-d7aa-4765-a80c-bc727454d1df tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:21.661388 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ffa98ba3-d7aa-4765-a80c-bc727454d1df tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:21.765239 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-ffa98ba3-d7aa-4765-a80c-bc727454d1df tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:21.774274 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-ffa98ba3-d7aa-4765-a80c-bc727454d1df tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1293 microversion: 2.1 time: 0.141355 Jul 05 16:09:21.775164 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 51/95] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:21 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1293 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:21.805848 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-77e9584f-cbb8-44b3-9388-05278354d218 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89990bfd774417ab0eb52b91ec560d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba872aaf0fd84b1eac87e18659d222d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:21.814734 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-77e9584f-cbb8-44b3-9388-05278354d218 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 200 len: 1315 microversion: 2.1 time: 0.275094 Jul 05 16:09:21.815319 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 45/96] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:21 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:21.957478 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [req-9ec22476-6fe5-44e1-ad86-b2c0815c5cf0 req-e8bf8769-b3e8-49f3-8247-2a04b88cefea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4233316e-f948-4729-a298-95bfa8d528da", "tag": "0d3daec4-e5f2-405e-a531-5ab8f6778220"}]} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:09:21.981304 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell0:SELECT=6 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:09:21.984196 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-9ec22476-6fe5-44e1-ad86-b2c0815c5cf0 req-e8bf8769-b3e8-49f3-8247-2a04b88cefea service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:21.985803 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-9ec22476-6fe5-44e1-ad86-b2c0815c5cf0 req-e8bf8769-b3e8-49f3-8247-2a04b88cefea service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:22.018839 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.compute.server_external_events [req-9ec22476-6fe5-44e1-ad86-b2c0815c5cf0 req-e8bf8769-b3e8-49f3-8247-2a04b88cefea service nova] Creating event network-changed:0d3daec4-e5f2-405e-a531-5ab8f6778220 for instance 4233316e-f948-4729-a298-95bfa8d528da on hv-cinder-84875 Jul 05 16:09:22.019614 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-9ec22476-6fe5-44e1-ad86-b2c0815c5cf0 req-e8bf8769-b3e8-49f3-8247-2a04b88cefea service nova] Acquired lock "compute-rpcapi-router" {{(pid=118319) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 05 16:09:22.021480 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3d1cc467-da57-4144-b0bb-fea944cabc67 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:22.022084 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3d1cc467-da57-4144-b0bb-fea944cabc67 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:22.023064 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3d1cc467-da57-4144-b0bb-fea944cabc67 None None] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:22.023651 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3d1cc467-da57-4144-b0bb-fea944cabc67 None None] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:22.034141 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.compute.rpcapi [None req-3d1cc467-da57-4144-b0bb-fea944cabc67 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 05 16:09:22.035295 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3d1cc467-da57-4144-b0bb-fea944cabc67 None None] Releasing lock "compute-rpcapi-router" {{(pid=118319) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 05 16:09:22.073345 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-3d1cc467-da57-4144-b0bb-fea944cabc67 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121065 Jul 05 16:09:22.074997 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 52/97] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:09:22.194106 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-9de51064-ae08-4238-a6e3-6bc37aacc87e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:22.194805 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-9de51064-ae08-4238-a6e3-6bc37aacc87e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:22.202857 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9de51064-ae08-4238-a6e3-6bc37aacc87e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:22.203239 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9de51064-ae08-4238-a6e3-6bc37aacc87e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:22.204025 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9de51064-ae08-4238-a6e3-6bc37aacc87e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:22.204468 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9de51064-ae08-4238-a6e3-6bc37aacc87e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:22.304956 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-9de51064-ae08-4238-a6e3-6bc37aacc87e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:22.322080 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-9de51064-ae08-4238-a6e3-6bc37aacc87e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1281 microversion: 2.1 time: 0.123011 Jul 05 16:09:22.322989 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 46/98] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:22 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1281 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:22.528033 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-72eadecd-d32d-498e-a018-02b9d238d3d3 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:22.529013 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-72eadecd-d32d-498e-a018-02b9d238d3d3 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:22.537604 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-72eadecd-d32d-498e-a018-02b9d238d3d3 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:22.538057 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-72eadecd-d32d-498e-a018-02b9d238d3d3 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:22.538832 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-72eadecd-d32d-498e-a018-02b9d238d3d3 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:22.539432 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-72eadecd-d32d-498e-a018-02b9d238d3d3 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:22.638668 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell0:SELECT=30 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:09:22.651546 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-2efdf2bb-a5f4-41d0-bd67-0419f53d224a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:22.652283 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-2efdf2bb-a5f4-41d0-bd67-0419f53d224a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:22.667076 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2efdf2bb-a5f4-41d0-bd67-0419f53d224a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:22.668170 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2efdf2bb-a5f4-41d0-bd67-0419f53d224a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:22.670603 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2efdf2bb-a5f4-41d0-bd67-0419f53d224a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:22.672613 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2efdf2bb-a5f4-41d0-bd67-0419f53d224a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:22.674397 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell0:SELECT=30 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:09:22.814193 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-2efdf2bb-a5f4-41d0-bd67-0419f53d224a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:22.825653 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-72eadecd-d32d-498e-a018-02b9d238d3d3 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:22.839951 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-72eadecd-d32d-498e-a018-02b9d238d3d3 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1362 microversion: 2.1 time: 0.318907 Jul 05 16:09:22.854900 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 53/99] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:22 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1362 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:22.857430 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-41c00a80-6889-48f0-8d1f-bfdf574d476b tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:22.858288 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-41c00a80-6889-48f0-8d1f-bfdf574d476b tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:22.859788 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-2efdf2bb-a5f4-41d0-bd67-0419f53d224a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:22.861577 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-2efdf2bb-a5f4-41d0-bd67-0419f53d224a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:22.862721 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-2efdf2bb-a5f4-41d0-bd67-0419f53d224a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1333 microversion: 2.20 time: 0.216361 Jul 05 16:09:22.864661 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-41c00a80-6889-48f0-8d1f-bfdf574d476b tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:22.865318 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-41c00a80-6889-48f0-8d1f-bfdf574d476b tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:22.866286 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-41c00a80-6889-48f0-8d1f-bfdf574d476b tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:22.867296 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-41c00a80-6889-48f0-8d1f-bfdf574d476b tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:22.882173 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 47/100] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:09:22 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1333 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:09:22.893384 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-4ab96fd3-2b7f-49d3-a38a-035938c31d35 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:22.894019 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-4ab96fd3-2b7f-49d3-a38a-035938c31d35 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:22.951370 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4ab96fd3-2b7f-49d3-a38a-035938c31d35 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:22.951848 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4ab96fd3-2b7f-49d3-a38a-035938c31d35 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:22.952660 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4ab96fd3-2b7f-49d3-a38a-035938c31d35 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:22.955949 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4ab96fd3-2b7f-49d3-a38a-035938c31d35 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:23.046599 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-41c00a80-6889-48f0-8d1f-bfdf574d476b tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:23.061852 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-41c00a80-6889-48f0-8d1f-bfdf574d476b tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1293 microversion: 2.1 time: 0.214900 Jul 05 16:09:23.063938 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 54/101] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:22 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1293 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:23.201011 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-4ab96fd3-2b7f-49d3-a38a-035938c31d35 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89990bfd774417ab0eb52b91ec560d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba872aaf0fd84b1eac87e18659d222d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:23.210144 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-4ab96fd3-2b7f-49d3-a38a-035938c31d35 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 200 len: 1315 microversion: 2.1 time: 0.326833 Jul 05 16:09:23.213244 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 48/102] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:22 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:23.342326 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-33c7a3d5-4a60-4e0e-bf4c-155cd04ad627 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:23.343068 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-33c7a3d5-4a60-4e0e-bf4c-155cd04ad627 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:23.366792 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-33c7a3d5-4a60-4e0e-bf4c-155cd04ad627 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:23.370136 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-33c7a3d5-4a60-4e0e-bf4c-155cd04ad627 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:23.372743 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-33c7a3d5-4a60-4e0e-bf4c-155cd04ad627 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:23.373215 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-33c7a3d5-4a60-4e0e-bf4c-155cd04ad627 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:23.557520 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-33c7a3d5-4a60-4e0e-bf4c-155cd04ad627 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:23.569188 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-33c7a3d5-4a60-4e0e-bf4c-155cd04ad627 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1281 microversion: 2.1 time: 0.229155 Jul 05 16:09:23.571025 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 55/103] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:23 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1281 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:23.863833 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-1d123ed9-b632-40e2-951b-1d64f155217c tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:23.865225 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-1d123ed9-b632-40e2-951b-1d64f155217c tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:23.872380 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1d123ed9-b632-40e2-951b-1d64f155217c tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:23.872879 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1d123ed9-b632-40e2-951b-1d64f155217c tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:23.873648 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1d123ed9-b632-40e2-951b-1d64f155217c tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:23.874091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1d123ed9-b632-40e2-951b-1d64f155217c tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:23.900744 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-21347499-eda2-4c65-8f91-6217e441e8e7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:23.901694 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-21347499-eda2-4c65-8f91-6217e441e8e7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:23.917402 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-21347499-eda2-4c65-8f91-6217e441e8e7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:23.918094 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-21347499-eda2-4c65-8f91-6217e441e8e7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:23.919076 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-21347499-eda2-4c65-8f91-6217e441e8e7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:23.919662 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-21347499-eda2-4c65-8f91-6217e441e8e7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:24.113339 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-21347499-eda2-4c65-8f91-6217e441e8e7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:24.122061 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-21347499-eda2-4c65-8f91-6217e441e8e7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:24.123783 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-21347499-eda2-4c65-8f91-6217e441e8e7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:24.125373 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-21347499-eda2-4c65-8f91-6217e441e8e7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1341 microversion: 2.20 time: 0.229412 Jul 05 16:09:24.136816 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 56/104] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:09:23 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1341 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:09:24.136816 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-c5bb8606-0cab-4aeb-9cdb-f30db924c89c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:24.136816 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-c5bb8606-0cab-4aeb-9cdb-f30db924c89c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:24.142552 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c5bb8606-0cab-4aeb-9cdb-f30db924c89c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:24.143138 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c5bb8606-0cab-4aeb-9cdb-f30db924c89c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:24.143911 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c5bb8606-0cab-4aeb-9cdb-f30db924c89c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:24.145275 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c5bb8606-0cab-4aeb-9cdb-f30db924c89c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:24.233658 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-c5bb8606-0cab-4aeb-9cdb-f30db924c89c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:24.242345 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-c5bb8606-0cab-4aeb-9cdb-f30db924c89c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1311 microversion: 2.1 time: 0.114915 Jul 05 16:09:24.243273 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 57/105] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:24 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1311 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:24.247860 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-a7fa9381-642b-4e73-bde1-7836172de68d tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:24.248476 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-a7fa9381-642b-4e73-bde1-7836172de68d tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:24.250666 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-1d123ed9-b632-40e2-951b-1d64f155217c tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:24.256281 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a7fa9381-642b-4e73-bde1-7836172de68d tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:24.256733 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a7fa9381-642b-4e73-bde1-7836172de68d tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:24.257531 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a7fa9381-642b-4e73-bde1-7836172de68d tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:24.257972 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a7fa9381-642b-4e73-bde1-7836172de68d tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:24.260280 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-1d123ed9-b632-40e2-951b-1d64f155217c tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1362 microversion: 2.1 time: 0.400364 Jul 05 16:09:24.271835 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 49/106] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:23 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1362 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:24.408584 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-a7fa9381-642b-4e73-bde1-7836172de68d tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89990bfd774417ab0eb52b91ec560d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba872aaf0fd84b1eac87e18659d222d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:24.416739 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-a7fa9381-642b-4e73-bde1-7836172de68d tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 200 len: 1315 microversion: 2.1 time: 0.172688 Jul 05 16:09:24.417722 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 58/107] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:24 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:24.589455 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-a810b757-8b0a-401e-8f86-79106f021608 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:24.590069 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-a810b757-8b0a-401e-8f86-79106f021608 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:24.596296 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a810b757-8b0a-401e-8f86-79106f021608 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:24.596840 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a810b757-8b0a-401e-8f86-79106f021608 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:24.597588 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a810b757-8b0a-401e-8f86-79106f021608 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:24.598026 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a810b757-8b0a-401e-8f86-79106f021608 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:24.660859 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-a810b757-8b0a-401e-8f86-79106f021608 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:24.668262 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-a810b757-8b0a-401e-8f86-79106f021608 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1279 microversion: 2.1 time: 0.083683 Jul 05 16:09:24.671537 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 50/108] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:24 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1279 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:25.143439 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-9ff2358b-ac1d-402c-9d39-94ec16d978ae tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:25.146090 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-9ff2358b-ac1d-402c-9d39-94ec16d978ae tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:25.163524 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9ff2358b-ac1d-402c-9d39-94ec16d978ae tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:25.163974 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9ff2358b-ac1d-402c-9d39-94ec16d978ae tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:25.173759 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9ff2358b-ac1d-402c-9d39-94ec16d978ae tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:25.174441 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9ff2358b-ac1d-402c-9d39-94ec16d978ae tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:25.215739 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell1:SELECT=100 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:09:25.260994 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-53c5ca75-1a33-432a-b650-fac5d7959131 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:25.262261 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-53c5ca75-1a33-432a-b650-fac5d7959131 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:25.283919 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-53c5ca75-1a33-432a-b650-fac5d7959131 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:25.308950 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-53c5ca75-1a33-432a-b650-fac5d7959131 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:25.308950 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-53c5ca75-1a33-432a-b650-fac5d7959131 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:25.308950 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-53c5ca75-1a33-432a-b650-fac5d7959131 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:25.326268 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-9ff2358b-ac1d-402c-9d39-94ec16d978ae tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:25.338146 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-9ff2358b-ac1d-402c-9d39-94ec16d978ae tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:25.339662 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-9ff2358b-ac1d-402c-9d39-94ec16d978ae tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:25.345393 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-9ff2358b-ac1d-402c-9d39-94ec16d978ae tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1341 microversion: 2.20 time: 0.205642 Jul 05 16:09:25.345997 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 59/109] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:09:25 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1341 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:09:25.353074 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-d01d2532-e8fb-4a96-a749-08919add5229 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:25.353888 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-d01d2532-e8fb-4a96-a749-08919add5229 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:25.382771 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d01d2532-e8fb-4a96-a749-08919add5229 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:25.383251 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d01d2532-e8fb-4a96-a749-08919add5229 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:25.384045 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d01d2532-e8fb-4a96-a749-08919add5229 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:25.384530 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d01d2532-e8fb-4a96-a749-08919add5229 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:25.422774 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-53c5ca75-1a33-432a-b650-fac5d7959131 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:25.452365 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-53c5ca75-1a33-432a-b650-fac5d7959131 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1311 microversion: 2.1 time: 0.196761 Jul 05 16:09:25.461540 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 51/110] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:25 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1311 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:09:25.478985 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-02715720-00fe-4a5b-bf69-e1e6bc80f4df req-6554964c-2f44-4aa9-a471-8e94d2f7634b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b902cfe-0e0b-4ce5-b2df-67ca0464da74", "tag": "08ca39e5-59e1-4f7a-887b-ceb7fc9c4671"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:09:25.507883 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-02715720-00fe-4a5b-bf69-e1e6bc80f4df req-6554964c-2f44-4aa9-a471-8e94d2f7634b service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:25.510854 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-02715720-00fe-4a5b-bf69-e1e6bc80f4df req-6554964c-2f44-4aa9-a471-8e94d2f7634b service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:25.531990 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-02715720-00fe-4a5b-bf69-e1e6bc80f4df req-6554964c-2f44-4aa9-a471-8e94d2f7634b service nova] Creating event network-changed:08ca39e5-59e1-4f7a-887b-ceb7fc9c4671 for instance 9b902cfe-0e0b-4ce5-b2df-67ca0464da74 on hv-cinder-84875 Jul 05 16:09:25.538632 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-02715720-00fe-4a5b-bf69-e1e6bc80f4df req-6554964c-2f44-4aa9-a471-8e94d2f7634b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075718 Jul 05 16:09:25.543232 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 52/111] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:09:25.549838 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-4f7db5fa-76f3-4d71-8535-6a1be9974a65 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:25.550566 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-4f7db5fa-76f3-4d71-8535-6a1be9974a65 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:25.557815 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4f7db5fa-76f3-4d71-8535-6a1be9974a65 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:25.558334 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4f7db5fa-76f3-4d71-8535-6a1be9974a65 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:25.559133 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4f7db5fa-76f3-4d71-8535-6a1be9974a65 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:25.559858 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4f7db5fa-76f3-4d71-8535-6a1be9974a65 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:25.703820 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-d01d2532-e8fb-4a96-a749-08919add5229 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:25.713946 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-d01d2532-e8fb-4a96-a749-08919add5229 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1362 microversion: 2.1 time: 0.365127 Jul 05 16:09:25.727628 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 60/112] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:25 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1362 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:25.727628 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-da2e2955-f861-4aa9-87a3-dd8fb2cfb3e4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:25.727628 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-da2e2955-f861-4aa9-87a3-dd8fb2cfb3e4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:25.728092 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-da2e2955-f861-4aa9-87a3-dd8fb2cfb3e4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:25.728300 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-da2e2955-f861-4aa9-87a3-dd8fb2cfb3e4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:25.729310 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-da2e2955-f861-4aa9-87a3-dd8fb2cfb3e4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:25.729746 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-da2e2955-f861-4aa9-87a3-dd8fb2cfb3e4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:25.797863 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-4f7db5fa-76f3-4d71-8535-6a1be9974a65 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89990bfd774417ab0eb52b91ec560d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba872aaf0fd84b1eac87e18659d222d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:25.809932 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-4f7db5fa-76f3-4d71-8535-6a1be9974a65 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 200 len: 1315 microversion: 2.1 time: 0.265197 Jul 05 16:09:25.811966 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 53/113] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:25 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:25.928172 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-da2e2955-f861-4aa9-87a3-dd8fb2cfb3e4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:25.950103 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-da2e2955-f861-4aa9-87a3-dd8fb2cfb3e4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1321 microversion: 2.1 time: 0.220462 Jul 05 16:09:25.950103 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 61/114] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:25 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:26.367712 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-6fd68bf7-5057-42dc-ac47-9470bd59b6ad tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:26.368655 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-6fd68bf7-5057-42dc-ac47-9470bd59b6ad tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:26.376241 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6fd68bf7-5057-42dc-ac47-9470bd59b6ad tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:26.376698 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6fd68bf7-5057-42dc-ac47-9470bd59b6ad tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:26.377835 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6fd68bf7-5057-42dc-ac47-9470bd59b6ad tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:26.378289 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6fd68bf7-5057-42dc-ac47-9470bd59b6ad tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:26.443897 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-6fd68bf7-5057-42dc-ac47-9470bd59b6ad tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:26.452455 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-6fd68bf7-5057-42dc-ac47-9470bd59b6ad tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:26.454119 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-6fd68bf7-5057-42dc-ac47-9470bd59b6ad tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:26.455437 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-6fd68bf7-5057-42dc-ac47-9470bd59b6ad tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1341 microversion: 2.20 time: 0.094365 Jul 05 16:09:26.455999 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 54/115] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:09:26 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1341 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:09:26.476538 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-3a7da4df-c942-457b-9f7c-ad2629ac304d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:26.477186 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-3a7da4df-c942-457b-9f7c-ad2629ac304d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:26.490561 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3a7da4df-c942-457b-9f7c-ad2629ac304d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:26.490561 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3a7da4df-c942-457b-9f7c-ad2629ac304d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:26.490561 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3a7da4df-c942-457b-9f7c-ad2629ac304d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:26.490561 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3a7da4df-c942-457b-9f7c-ad2629ac304d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:26.569950 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-3a7da4df-c942-457b-9f7c-ad2629ac304d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:26.569950 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-3a7da4df-c942-457b-9f7c-ad2629ac304d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1311 microversion: 2.1 time: 0.095281 Jul 05 16:09:26.569950 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 62/116] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:26 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:26.731438 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-9c509008-d2f2-44ae-906a-16d19fecc3bf tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:26.732181 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-9c509008-d2f2-44ae-906a-16d19fecc3bf tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:26.739383 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9c509008-d2f2-44ae-906a-16d19fecc3bf tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:26.740388 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9c509008-d2f2-44ae-906a-16d19fecc3bf tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:26.741262 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9c509008-d2f2-44ae-906a-16d19fecc3bf tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:26.741655 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9c509008-d2f2-44ae-906a-16d19fecc3bf tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:26.827595 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-66605b02-0f6b-414a-b587-bda47b7f9db6 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:26.828290 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-66605b02-0f6b-414a-b587-bda47b7f9db6 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:26.834386 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-66605b02-0f6b-414a-b587-bda47b7f9db6 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:26.834907 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-66605b02-0f6b-414a-b587-bda47b7f9db6 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:26.835758 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-66605b02-0f6b-414a-b587-bda47b7f9db6 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:26.836267 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-66605b02-0f6b-414a-b587-bda47b7f9db6 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:26.883867 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-9c509008-d2f2-44ae-906a-16d19fecc3bf tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:26.891332 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-9c509008-d2f2-44ae-906a-16d19fecc3bf tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1362 microversion: 2.1 time: 0.164082 Jul 05 16:09:26.891909 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 55/117] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:26 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:26.958229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-6bc43750-535a-4c29-9544-5a85576ef88c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:26.958837 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-6bc43750-535a-4c29-9544-5a85576ef88c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:26.965124 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6bc43750-535a-4c29-9544-5a85576ef88c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:26.965445 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-66605b02-0f6b-414a-b587-bda47b7f9db6 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89990bfd774417ab0eb52b91ec560d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba872aaf0fd84b1eac87e18659d222d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:26.965604 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6bc43750-535a-4c29-9544-5a85576ef88c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:26.966327 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6bc43750-535a-4c29-9544-5a85576ef88c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:26.966761 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6bc43750-535a-4c29-9544-5a85576ef88c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:26.973412 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-66605b02-0f6b-414a-b587-bda47b7f9db6 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 200 len: 1315 microversion: 2.1 time: 0.149708 Jul 05 16:09:26.979021 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 63/118] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:26 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:27.109184 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-6bc43750-535a-4c29-9544-5a85576ef88c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:27.117291 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-6bc43750-535a-4c29-9544-5a85576ef88c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1321 microversion: 2.1 time: 0.163501 Jul 05 16:09:27.117854 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 56/119] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:26 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:09:27.479618 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-9b140de5-eb27-41e4-ac70-e0b223c0066f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:27.481344 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-9b140de5-eb27-41e4-ac70-e0b223c0066f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:27.514189 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9b140de5-eb27-41e4-ac70-e0b223c0066f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:27.518806 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9b140de5-eb27-41e4-ac70-e0b223c0066f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:27.522416 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9b140de5-eb27-41e4-ac70-e0b223c0066f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:27.523322 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9b140de5-eb27-41e4-ac70-e0b223c0066f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:27.584631 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-f713e6e3-b249-49d6-b030-6838c7f0f540 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:27.585866 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-f713e6e3-b249-49d6-b030-6838c7f0f540 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:27.593520 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f713e6e3-b249-49d6-b030-6838c7f0f540 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:27.597639 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f713e6e3-b249-49d6-b030-6838c7f0f540 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:27.598631 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f713e6e3-b249-49d6-b030-6838c7f0f540 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:27.601247 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f713e6e3-b249-49d6-b030-6838c7f0f540 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:27.795100 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-9b140de5-eb27-41e4-ac70-e0b223c0066f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:27.807571 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-9b140de5-eb27-41e4-ac70-e0b223c0066f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:27.809096 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-9b140de5-eb27-41e4-ac70-e0b223c0066f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:27.811398 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-9b140de5-eb27-41e4-ac70-e0b223c0066f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1341 microversion: 2.20 time: 0.340505 Jul 05 16:09:27.811973 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 64/120] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:09:27 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1341 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:09:27.907908 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-69346de3-c3d3-442b-bbf8-bbcee70062cf tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:27.908517 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-69346de3-c3d3-442b-bbf8-bbcee70062cf tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:27.916806 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-69346de3-c3d3-442b-bbf8-bbcee70062cf tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:27.917258 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-69346de3-c3d3-442b-bbf8-bbcee70062cf tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:27.918032 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-69346de3-c3d3-442b-bbf8-bbcee70062cf tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:27.918465 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-69346de3-c3d3-442b-bbf8-bbcee70062cf tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:27.933941 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-f713e6e3-b249-49d6-b030-6838c7f0f540 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:27.943593 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-f713e6e3-b249-49d6-b030-6838c7f0f540 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1299 microversion: 2.1 time: 0.363235 Jul 05 16:09:27.952621 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 57/121] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:27 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1299 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:27.992124 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-2b1c47a8-350b-47fe-8b55-311d64e06241 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:27.993027 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-2b1c47a8-350b-47fe-8b55-311d64e06241 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:28.003146 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2b1c47a8-350b-47fe-8b55-311d64e06241 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:28.003596 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2b1c47a8-350b-47fe-8b55-311d64e06241 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:28.004381 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2b1c47a8-350b-47fe-8b55-311d64e06241 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:28.004841 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2b1c47a8-350b-47fe-8b55-311d64e06241 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:28.761674 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-69346de3-c3d3-442b-bbf8-bbcee70062cf tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:28.773577 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-69346de3-c3d3-442b-bbf8-bbcee70062cf tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1362 microversion: 2.1 time: 0.869389 Jul 05 16:09:28.776359 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 65/122] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:27 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1362 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:28.781248 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-36daab08-880d-40cc-89e0-d7300cb4bbee tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:28.781871 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-36daab08-880d-40cc-89e0-d7300cb4bbee tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:28.788863 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-36daab08-880d-40cc-89e0-d7300cb4bbee tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:28.789312 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-36daab08-880d-40cc-89e0-d7300cb4bbee tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:28.790079 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-36daab08-880d-40cc-89e0-d7300cb4bbee tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:28.790583 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-36daab08-880d-40cc-89e0-d7300cb4bbee tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:28.881196 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-2b1c47a8-350b-47fe-8b55-311d64e06241 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89990bfd774417ab0eb52b91ec560d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba872aaf0fd84b1eac87e18659d222d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:28.890976 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-2b1c47a8-350b-47fe-8b55-311d64e06241 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 200 len: 1315 microversion: 2.1 time: 0.903880 Jul 05 16:09:28.891662 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 58/123] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:27 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 1315 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:28.896424 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-f122350e-edb2-465c-a734-c635bfd2f086 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:28.897327 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-f122350e-edb2-465c-a734-c635bfd2f086 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:28.907405 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f122350e-edb2-465c-a734-c635bfd2f086 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:28.908026 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f122350e-edb2-465c-a734-c635bfd2f086 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:28.909124 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f122350e-edb2-465c-a734-c635bfd2f086 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:28.909946 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f122350e-edb2-465c-a734-c635bfd2f086 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:28.915691 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=100 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:09:29.125770 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-f122350e-edb2-465c-a734-c635bfd2f086 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:29.134204 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-f122350e-edb2-465c-a734-c635bfd2f086 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:29.135715 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-f122350e-edb2-465c-a734-c635bfd2f086 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:29.136865 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-f122350e-edb2-465c-a734-c635bfd2f086 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1339 microversion: 2.20 time: 0.244013 Jul 05 16:09:29.149146 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 59/124] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:09:28 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1339 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:09:29.154819 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-8bb5e88c-a9ab-4d06-8363-4d1b8016c7e7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:29.155597 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-8bb5e88c-a9ab-4d06-8363-4d1b8016c7e7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:29.172752 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8bb5e88c-a9ab-4d06-8363-4d1b8016c7e7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:29.172752 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8bb5e88c-a9ab-4d06-8363-4d1b8016c7e7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:29.173196 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8bb5e88c-a9ab-4d06-8363-4d1b8016c7e7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:29.173770 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8bb5e88c-a9ab-4d06-8363-4d1b8016c7e7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:29.363634 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-8bb5e88c-a9ab-4d06-8363-4d1b8016c7e7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:29.370033 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-8bb5e88c-a9ab-4d06-8363-4d1b8016c7e7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1299 microversion: 2.1 time: 0.219260 Jul 05 16:09:29.371137 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 60/125] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:29 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1299 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:29.433411 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-36daab08-880d-40cc-89e0-d7300cb4bbee tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:29.441894 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-36daab08-880d-40cc-89e0-d7300cb4bbee tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1321 microversion: 2.1 time: 0.664398 Jul 05 16:09:29.442563 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 66/126] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:28 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1321 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:29.791817 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-04806593-be95-4a62-a7bd-39ce8ee57107 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:29.792453 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-04806593-be95-4a62-a7bd-39ce8ee57107 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:29.813851 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-04806593-be95-4a62-a7bd-39ce8ee57107 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:29.814304 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-04806593-be95-4a62-a7bd-39ce8ee57107 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:29.815083 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-04806593-be95-4a62-a7bd-39ce8ee57107 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:29.815518 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-04806593-be95-4a62-a7bd-39ce8ee57107 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:29.909858 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-39e622c4-9162-4c2b-96cd-978c68782b28 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:29.911082 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-39e622c4-9162-4c2b-96cd-978c68782b28 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:29.915197 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell0:SELECT=8 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:09:29.920714 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-39e622c4-9162-4c2b-96cd-978c68782b28 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:29.920714 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-39e622c4-9162-4c2b-96cd-978c68782b28 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:29.921213 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-39e622c4-9162-4c2b-96cd-978c68782b28 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:29.924711 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-39e622c4-9162-4c2b-96cd-978c68782b28 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:30.215443 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-04806593-be95-4a62-a7bd-39ce8ee57107 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:30.228424 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-04806593-be95-4a62-a7bd-39ce8ee57107 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1362 microversion: 2.1 time: 0.436605 Jul 05 16:09:30.230473 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 61/127] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:29 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1362 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:30.236965 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-f7ad8554-b2ca-4a92-8290-e5195a35f04c req-17ed8f29-fc67-4e93-acad-d3889d6b8305 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d712774-90eb-4130-916f-046ba6b891a0", "tag": "426e703b-fda9-4cb3-9ba0-62242cbd02d2"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:09:30.247492 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-f7ad8554-b2ca-4a92-8290-e5195a35f04c req-17ed8f29-fc67-4e93-acad-d3889d6b8305 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:30.248039 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-f7ad8554-b2ca-4a92-8290-e5195a35f04c req-17ed8f29-fc67-4e93-acad-d3889d6b8305 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:30.262963 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-f7ad8554-b2ca-4a92-8290-e5195a35f04c req-17ed8f29-fc67-4e93-acad-d3889d6b8305 service nova] Creating event network-changed:426e703b-fda9-4cb3-9ba0-62242cbd02d2 for instance 2d712774-90eb-4130-916f-046ba6b891a0 on hv-cinder-84875 Jul 05 16:09:30.277345 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-f7ad8554-b2ca-4a92-8290-e5195a35f04c req-17ed8f29-fc67-4e93-acad-d3889d6b8305 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041584 Jul 05 16:09:30.282271 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 62/128] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:09:30.303739 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-aad871d5-9a94-461b-932e-b5e2e339d2fc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:30.314190 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-aad871d5-9a94-461b-932e-b5e2e339d2fc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:30.323211 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-aad871d5-9a94-461b-932e-b5e2e339d2fc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:30.323674 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-aad871d5-9a94-461b-932e-b5e2e339d2fc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:30.325244 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-aad871d5-9a94-461b-932e-b5e2e339d2fc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:30.325707 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-aad871d5-9a94-461b-932e-b5e2e339d2fc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:30.528553 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-39e622c4-9162-4c2b-96cd-978c68782b28 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89990bfd774417ab0eb52b91ec560d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba872aaf0fd84b1eac87e18659d222d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:30.538717 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-39e622c4-9162-4c2b-96cd-978c68782b28 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 200 len: 1315 microversion: 2.1 time: 0.634696 Jul 05 16:09:30.539444 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 67/129] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:29 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 1315 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:30.544379 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-e02faf0f-33ac-4a14-9295-8127a1d332e1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:30.545020 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-e02faf0f-33ac-4a14-9295-8127a1d332e1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:30.554536 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e02faf0f-33ac-4a14-9295-8127a1d332e1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:30.555196 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e02faf0f-33ac-4a14-9295-8127a1d332e1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:30.556191 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e02faf0f-33ac-4a14-9295-8127a1d332e1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:30.556855 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e02faf0f-33ac-4a14-9295-8127a1d332e1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:30.618649 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-aad871d5-9a94-461b-932e-b5e2e339d2fc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:30.627117 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-aad871d5-9a94-461b-932e-b5e2e339d2fc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:30.628568 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-aad871d5-9a94-461b-932e-b5e2e339d2fc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:30.629735 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-aad871d5-9a94-461b-932e-b5e2e339d2fc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1406 microversion: 2.20 time: 0.345980 Jul 05 16:09:30.630393 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 63/130] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:09:30 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1406 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:09:30.635159 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-fdcdfad9-2a42-4087-9e1d-06c91021914a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:30.635991 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-fdcdfad9-2a42-4087-9e1d-06c91021914a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:30.642082 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fdcdfad9-2a42-4087-9e1d-06c91021914a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:30.644247 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fdcdfad9-2a42-4087-9e1d-06c91021914a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:30.644247 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fdcdfad9-2a42-4087-9e1d-06c91021914a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:30.644247 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fdcdfad9-2a42-4087-9e1d-06c91021914a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:30.916994 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-e02faf0f-33ac-4a14-9295-8127a1d332e1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:30.926347 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-e02faf0f-33ac-4a14-9295-8127a1d332e1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1367 microversion: 2.1 time: 0.385884 Jul 05 16:09:30.931027 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 68/131] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:30 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1367 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:31.027018 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-fdcdfad9-2a42-4087-9e1d-06c91021914a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:31.035722 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-fdcdfad9-2a42-4087-9e1d-06c91021914a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1321 microversion: 2.1 time: 0.404092 Jul 05 16:09:31.036318 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 64/132] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:30 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1321 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:31.246674 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-1eac86f9-3308-455d-b2b0-f4d6d6397d80 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:31.247278 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-1eac86f9-3308-455d-b2b0-f4d6d6397d80 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:31.255887 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1eac86f9-3308-455d-b2b0-f4d6d6397d80 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:31.256344 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1eac86f9-3308-455d-b2b0-f4d6d6397d80 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:31.257170 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1eac86f9-3308-455d-b2b0-f4d6d6397d80 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:31.257604 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1eac86f9-3308-455d-b2b0-f4d6d6397d80 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:31.556982 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-9ad8ed39-7bf9-461c-8c81-8a7a4d477b12 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:31.559141 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-9ad8ed39-7bf9-461c-8c81-8a7a4d477b12 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:31.569303 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9ad8ed39-7bf9-461c-8c81-8a7a4d477b12 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:31.571047 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9ad8ed39-7bf9-461c-8c81-8a7a4d477b12 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:31.572036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9ad8ed39-7bf9-461c-8c81-8a7a4d477b12 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:31.573019 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9ad8ed39-7bf9-461c-8c81-8a7a4d477b12 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:31.619084 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-1eac86f9-3308-455d-b2b0-f4d6d6397d80 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:31.634291 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-1eac86f9-3308-455d-b2b0-f4d6d6397d80 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1362 microversion: 2.1 time: 0.391249 Jul 05 16:09:31.635225 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 69/133] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:31 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1362 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:31.648646 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-6ed8a45b-f253-46c5-908c-ee6f45af195d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:31.649360 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-6ed8a45b-f253-46c5-908c-ee6f45af195d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:31.663693 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-6ed8a45b-f253-46c5-908c-ee6f45af195d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:31.664303 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-6ed8a45b-f253-46c5-908c-ee6f45af195d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:31.665163 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-6ed8a45b-f253-46c5-908c-ee6f45af195d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:31.665611 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-6ed8a45b-f253-46c5-908c-ee6f45af195d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:32.193493 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-9ad8ed39-7bf9-461c-8c81-8a7a4d477b12 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89990bfd774417ab0eb52b91ec560d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba872aaf0fd84b1eac87e18659d222d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:32.204248 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-9ad8ed39-7bf9-461c-8c81-8a7a4d477b12 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 200 len: 1315 microversion: 2.1 time: 0.652504 Jul 05 16:09:32.205685 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 65/134] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:31 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 1315 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:09:32.212399 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-99adc5e0-7226-4648-9ae3-6a24faf4e88a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:32.213604 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-99adc5e0-7226-4648-9ae3-6a24faf4e88a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:32.221196 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-99adc5e0-7226-4648-9ae3-6a24faf4e88a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:32.221940 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-99adc5e0-7226-4648-9ae3-6a24faf4e88a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:32.222937 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-99adc5e0-7226-4648-9ae3-6a24faf4e88a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:32.223613 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-99adc5e0-7226-4648-9ae3-6a24faf4e88a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:32.250840 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-6ed8a45b-f253-46c5-908c-ee6f45af195d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:32.259837 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-6ed8a45b-f253-46c5-908c-ee6f45af195d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:32.261662 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-6ed8a45b-f253-46c5-908c-ee6f45af195d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:32.262880 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-6ed8a45b-f253-46c5-908c-ee6f45af195d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1406 microversion: 2.20 time: 0.618896 Jul 05 16:09:32.274697 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 70/135] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:09:31 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1406 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:09:32.280083 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-77ef156b-c4e1-43f2-ba6b-11e454a437eb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:32.280834 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-77ef156b-c4e1-43f2-ba6b-11e454a437eb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:32.288798 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-77ef156b-c4e1-43f2-ba6b-11e454a437eb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:32.289359 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-77ef156b-c4e1-43f2-ba6b-11e454a437eb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:32.290284 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-77ef156b-c4e1-43f2-ba6b-11e454a437eb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:32.290796 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-77ef156b-c4e1-43f2-ba6b-11e454a437eb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:32.534199 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell0:SELECT=2 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:09:32.753532 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-99adc5e0-7226-4648-9ae3-6a24faf4e88a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:32.762088 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-99adc5e0-7226-4648-9ae3-6a24faf4e88a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1367 microversion: 2.1 time: 0.554977 Jul 05 16:09:32.772020 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 66/136] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:32 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1367 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:32.772020 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-96cfb5ed-4ed5-4eeb-9211-bbd8d950e8a1 req-9227bb7a-4811-40f7-ba32-cf931f1c76af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da368d38-2642-49c3-b499-eb5a977cbd77", "tag": "c24636dc-9b24-45b5-a963-180931342e24"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:09:32.778583 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-96cfb5ed-4ed5-4eeb-9211-bbd8d950e8a1 req-9227bb7a-4811-40f7-ba32-cf931f1c76af service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:32.779141 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-96cfb5ed-4ed5-4eeb-9211-bbd8d950e8a1 req-9227bb7a-4811-40f7-ba32-cf931f1c76af service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:32.791586 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-96cfb5ed-4ed5-4eeb-9211-bbd8d950e8a1 req-9227bb7a-4811-40f7-ba32-cf931f1c76af service nova] Creating event network-changed:c24636dc-9b24-45b5-a963-180931342e24 for instance da368d38-2642-49c3-b499-eb5a977cbd77 on hv-cinder-84875 Jul 05 16:09:32.796743 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-96cfb5ed-4ed5-4eeb-9211-bbd8d950e8a1 req-9227bb7a-4811-40f7-ba32-cf931f1c76af service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032521 Jul 05 16:09:32.797371 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 67/137] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:09:32.804863 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-bb65fe41-7702-4b93-9b0d-d28b70340d86 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:32.805943 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-bb65fe41-7702-4b93-9b0d-d28b70340d86 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:32.812356 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bb65fe41-7702-4b93-9b0d-d28b70340d86 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:32.812806 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bb65fe41-7702-4b93-9b0d-d28b70340d86 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:32.813573 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bb65fe41-7702-4b93-9b0d-d28b70340d86 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:32.814007 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bb65fe41-7702-4b93-9b0d-d28b70340d86 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:32.817461 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-77ef156b-c4e1-43f2-ba6b-11e454a437eb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:32.832574 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-77ef156b-c4e1-43f2-ba6b-11e454a437eb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1321 microversion: 2.1 time: 0.556399 Jul 05 16:09:32.833370 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 71/138] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:32 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1321 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:32.972787 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-bb65fe41-7702-4b93-9b0d-d28b70340d86 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:32.981734 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-bb65fe41-7702-4b93-9b0d-d28b70340d86 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1362 microversion: 2.1 time: 0.183120 Jul 05 16:09:32.982401 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 68/139] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:32 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:33.225743 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-9951872b-3082-4d9c-b19d-eef24b1ec584 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:33.226541 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-9951872b-3082-4d9c-b19d-eef24b1ec584 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:33.243273 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9951872b-3082-4d9c-b19d-eef24b1ec584 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:33.244668 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9951872b-3082-4d9c-b19d-eef24b1ec584 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:33.246437 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9951872b-3082-4d9c-b19d-eef24b1ec584 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:33.248424 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9951872b-3082-4d9c-b19d-eef24b1ec584 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:33.296216 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-a2582d2d-6678-404d-ad30-235f214f1ade tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:33.296724 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-a2582d2d-6678-404d-ad30-235f214f1ade tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:33.305561 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a2582d2d-6678-404d-ad30-235f214f1ade tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:33.306152 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a2582d2d-6678-404d-ad30-235f214f1ade tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:33.307122 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a2582d2d-6678-404d-ad30-235f214f1ade tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:33.307727 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a2582d2d-6678-404d-ad30-235f214f1ade tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:33.542251 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-9951872b-3082-4d9c-b19d-eef24b1ec584 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89990bfd774417ab0eb52b91ec560d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba872aaf0fd84b1eac87e18659d222d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:33.552302 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-9951872b-3082-4d9c-b19d-eef24b1ec584 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 200 len: 1315 microversion: 2.1 time: 0.333882 Jul 05 16:09:33.553215 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 72/140] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:33 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:33.563168 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-a2582d2d-6678-404d-ad30-235f214f1ade tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:33.575958 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-a2582d2d-6678-404d-ad30-235f214f1ade tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:33.578193 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-a2582d2d-6678-404d-ad30-235f214f1ade tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:33.579494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-a2582d2d-6678-404d-ad30-235f214f1ade tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1406 microversion: 2.20 time: 0.297288 Jul 05 16:09:33.591206 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 69/141] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:09:33 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1406 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:09:33.638352 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [req-5a2cb571-2a5e-4369-9dab-f83b33566faf req-65977fcc-497d-4227-ad3d-ab96c267c13f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "478dac11-75cf-4e58-9ba7-e78469b8045a", "tag": "0d4a05ab-6ac5-4ab2-bad3-8b10a8823738"}]} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:09:33.644190 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-5a2cb571-2a5e-4369-9dab-f83b33566faf req-65977fcc-497d-4227-ad3d-ab96c267c13f service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:33.644722 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-5a2cb571-2a5e-4369-9dab-f83b33566faf req-65977fcc-497d-4227-ad3d-ab96c267c13f service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:33.656456 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.compute.server_external_events [req-5a2cb571-2a5e-4369-9dab-f83b33566faf req-65977fcc-497d-4227-ad3d-ab96c267c13f service nova] Creating event network-changed:0d4a05ab-6ac5-4ab2-bad3-8b10a8823738 for instance 478dac11-75cf-4e58-9ba7-e78469b8045a on hv-cinder-84875 Jul 05 16:09:33.661175 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [req-5a2cb571-2a5e-4369-9dab-f83b33566faf req-65977fcc-497d-4227-ad3d-ab96c267c13f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106538 Jul 05 16:09:33.662460 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 73/142] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:09:33.780282 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-4ace62e3-1bff-440e-ac00-f07219fec403 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:33.781512 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-4ace62e3-1bff-440e-ac00-f07219fec403 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:33.789443 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4ace62e3-1bff-440e-ac00-f07219fec403 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:33.789981 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4ace62e3-1bff-440e-ac00-f07219fec403 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:33.790837 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4ace62e3-1bff-440e-ac00-f07219fec403 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:33.791431 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4ace62e3-1bff-440e-ac00-f07219fec403 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:33.850898 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-0b724e5e-1fd0-4047-a4a5-f582100230a0 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:33.851606 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-0b724e5e-1fd0-4047-a4a5-f582100230a0 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:33.858221 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0b724e5e-1fd0-4047-a4a5-f582100230a0 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:33.858669 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0b724e5e-1fd0-4047-a4a5-f582100230a0 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:33.859706 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0b724e5e-1fd0-4047-a4a5-f582100230a0 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:33.860142 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0b724e5e-1fd0-4047-a4a5-f582100230a0 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:33.966499 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-4ace62e3-1bff-440e-ac00-f07219fec403 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:33.978213 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-4ace62e3-1bff-440e-ac00-f07219fec403 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1367 microversion: 2.1 time: 0.199628 Jul 05 16:09:33.978213 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 70/143] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:33 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:33.999043 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-0f8b153e-99b1-431f-badc-d46d2f4114e5 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:33.999645 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-0f8b153e-99b1-431f-badc-d46d2f4114e5 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:34.006294 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0f8b153e-99b1-431f-badc-d46d2f4114e5 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:34.006745 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0f8b153e-99b1-431f-badc-d46d2f4114e5 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:34.007502 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0f8b153e-99b1-431f-badc-d46d2f4114e5 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:34.008264 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0f8b153e-99b1-431f-badc-d46d2f4114e5 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:34.011317 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-0b724e5e-1fd0-4047-a4a5-f582100230a0 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:34.019390 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-0b724e5e-1fd0-4047-a4a5-f582100230a0 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1321 microversion: 2.1 time: 0.172638 Jul 05 16:09:34.020049 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 74/144] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:33 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:09:34.141894 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-0f8b153e-99b1-431f-badc-d46d2f4114e5 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:34.150334 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-0f8b153e-99b1-431f-badc-d46d2f4114e5 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1362 microversion: 2.1 time: 0.154997 Jul 05 16:09:34.150917 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 71/145] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:33 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:09:34.569631 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-66e36b61-0cbb-4aee-bff7-0126127409c4 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:34.570277 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-66e36b61-0cbb-4aee-bff7-0126127409c4 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:34.576161 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-66e36b61-0cbb-4aee-bff7-0126127409c4 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:34.576625 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-66e36b61-0cbb-4aee-bff7-0126127409c4 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:34.577385 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-66e36b61-0cbb-4aee-bff7-0126127409c4 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:34.577813 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-66e36b61-0cbb-4aee-bff7-0126127409c4 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:34.598002 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-013be358-6b56-4fa2-9972-4cd3103bf858 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:34.598617 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-013be358-6b56-4fa2-9972-4cd3103bf858 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:34.606652 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-013be358-6b56-4fa2-9972-4cd3103bf858 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:34.607134 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-013be358-6b56-4fa2-9972-4cd3103bf858 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:34.608030 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-013be358-6b56-4fa2-9972-4cd3103bf858 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:34.608726 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-013be358-6b56-4fa2-9972-4cd3103bf858 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:34.759604 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-66e36b61-0cbb-4aee-bff7-0126127409c4 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89990bfd774417ab0eb52b91ec560d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba872aaf0fd84b1eac87e18659d222d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:34.767272 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-66e36b61-0cbb-4aee-bff7-0126127409c4 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 200 len: 1315 microversion: 2.1 time: 0.202238 Jul 05 16:09:34.767844 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 75/146] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:34 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:34.780523 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-013be358-6b56-4fa2-9972-4cd3103bf858 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:34.789457 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-013be358-6b56-4fa2-9972-4cd3103bf858 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:34.791108 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-013be358-6b56-4fa2-9972-4cd3103bf858 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:34.793069 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-013be358-6b56-4fa2-9972-4cd3103bf858 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1406 microversion: 2.20 time: 0.198436 Jul 05 16:09:34.793314 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 72/147] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:09:34 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1406 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:09:34.991530 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-6d75289c-c172-4882-84ed-8a130713de6c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:34.992135 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-6d75289c-c172-4882-84ed-8a130713de6c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:34.998093 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-6d75289c-c172-4882-84ed-8a130713de6c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:34.998538 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-6d75289c-c172-4882-84ed-8a130713de6c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:34.999281 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-6d75289c-c172-4882-84ed-8a130713de6c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:34.999710 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-6d75289c-c172-4882-84ed-8a130713de6c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:35.037401 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-71c737fd-ee9d-483a-9c38-cc2f34b33320 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:35.038015 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-71c737fd-ee9d-483a-9c38-cc2f34b33320 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:35.044149 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-71c737fd-ee9d-483a-9c38-cc2f34b33320 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:35.044625 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-71c737fd-ee9d-483a-9c38-cc2f34b33320 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:35.045414 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-71c737fd-ee9d-483a-9c38-cc2f34b33320 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:35.045846 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-71c737fd-ee9d-483a-9c38-cc2f34b33320 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:35.187756 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-6d75289c-c172-4882-84ed-8a130713de6c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:35.199259 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell1:SELECT=100 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:09:35.204021 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-6d75289c-c172-4882-84ed-8a130713de6c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1367 microversion: 2.1 time: 0.216303 Jul 05 16:09:35.204685 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 76/148] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:34 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:35.210066 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-5a1732ec-dde9-48eb-8f5f-a9cf6edc9419 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:35.210739 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-5a1732ec-dde9-48eb-8f5f-a9cf6edc9419 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:35.217965 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-5a1732ec-dde9-48eb-8f5f-a9cf6edc9419 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:35.218494 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-5a1732ec-dde9-48eb-8f5f-a9cf6edc9419 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:35.219952 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-5a1732ec-dde9-48eb-8f5f-a9cf6edc9419 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:35.220446 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-5a1732ec-dde9-48eb-8f5f-a9cf6edc9419 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:35.222641 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-71c737fd-ee9d-483a-9c38-cc2f34b33320 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:35.231534 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-71c737fd-ee9d-483a-9c38-cc2f34b33320 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1321 microversion: 2.1 time: 0.198526 Jul 05 16:09:35.232119 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 73/149] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:35 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:09:35.358324 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-5a1732ec-dde9-48eb-8f5f-a9cf6edc9419 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:35.366091 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-5a1732ec-dde9-48eb-8f5f-a9cf6edc9419 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1362 microversion: 2.1 time: 0.160187 Jul 05 16:09:35.366664 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 77/150] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:35 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:35.784115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-8c8a4183-606b-4474-bafe-caa56798a0e7 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:35.784730 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-8c8a4183-606b-4474-bafe-caa56798a0e7 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:35.790756 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8c8a4183-606b-4474-bafe-caa56798a0e7 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:35.791200 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8c8a4183-606b-4474-bafe-caa56798a0e7 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:35.791955 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8c8a4183-606b-4474-bafe-caa56798a0e7 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:35.792386 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8c8a4183-606b-4474-bafe-caa56798a0e7 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:35.811326 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-a3fbfc49-ded7-4f1e-a2b5-7a1d465cbb17 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:35.811963 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-a3fbfc49-ded7-4f1e-a2b5-7a1d465cbb17 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:35.818797 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a3fbfc49-ded7-4f1e-a2b5-7a1d465cbb17 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:35.819238 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a3fbfc49-ded7-4f1e-a2b5-7a1d465cbb17 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:35.819985 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a3fbfc49-ded7-4f1e-a2b5-7a1d465cbb17 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:35.820420 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a3fbfc49-ded7-4f1e-a2b5-7a1d465cbb17 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:36.014037 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-8c8a4183-606b-4474-bafe-caa56798a0e7 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89990bfd774417ab0eb52b91ec560d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba872aaf0fd84b1eac87e18659d222d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:36.022648 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-8c8a4183-606b-4474-bafe-caa56798a0e7 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 200 len: 1315 microversion: 2.1 time: 0.242320 Jul 05 16:09:36.022861 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-a3fbfc49-ded7-4f1e-a2b5-7a1d465cbb17 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:36.023478 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 74/151] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:35 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:36.040713 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-a3fbfc49-ded7-4f1e-a2b5-7a1d465cbb17 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:36.042236 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-a3fbfc49-ded7-4f1e-a2b5-7a1d465cbb17 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:36.043464 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-a3fbfc49-ded7-4f1e-a2b5-7a1d465cbb17 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1406 microversion: 2.20 time: 0.236403 Jul 05 16:09:36.044061 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 78/152] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:09:35 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:09:36.221176 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-b820ee35-a7fc-4b1c-b392-00586ec8a7ff tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:36.221799 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-b820ee35-a7fc-4b1c-b392-00586ec8a7ff tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:36.228235 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b820ee35-a7fc-4b1c-b392-00586ec8a7ff tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:36.228685 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b820ee35-a7fc-4b1c-b392-00586ec8a7ff tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:36.229537 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b820ee35-a7fc-4b1c-b392-00586ec8a7ff tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:36.229974 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b820ee35-a7fc-4b1c-b392-00586ec8a7ff tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:36.248852 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-9e7583f5-1b36-42d8-80ed-a97c53d1aff8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:36.249584 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-9e7583f5-1b36-42d8-80ed-a97c53d1aff8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:36.256035 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9e7583f5-1b36-42d8-80ed-a97c53d1aff8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:36.256481 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9e7583f5-1b36-42d8-80ed-a97c53d1aff8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:36.260965 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9e7583f5-1b36-42d8-80ed-a97c53d1aff8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:36.260965 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9e7583f5-1b36-42d8-80ed-a97c53d1aff8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:36.438143 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-b820ee35-a7fc-4b1c-b392-00586ec8a7ff tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:36.441371 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-9e7583f5-1b36-42d8-80ed-a97c53d1aff8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:36.446929 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-b820ee35-a7fc-4b1c-b392-00586ec8a7ff tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1367 microversion: 2.1 time: 0.229612 Jul 05 16:09:36.447598 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 75/153] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:36 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:36.451297 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-9e7583f5-1b36-42d8-80ed-a97c53d1aff8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1321 microversion: 2.1 time: 0.206245 Jul 05 16:09:36.451945 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 79/154] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:36 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:09:36.452348 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-5c48e49d-a003-4404-b968-fe4d4a2220a3 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:36.453050 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-5c48e49d-a003-4404-b968-fe4d4a2220a3 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:36.458930 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5c48e49d-a003-4404-b968-fe4d4a2220a3 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:36.459381 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5c48e49d-a003-4404-b968-fe4d4a2220a3 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:36.460147 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5c48e49d-a003-4404-b968-fe4d4a2220a3 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:36.460798 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5c48e49d-a003-4404-b968-fe4d4a2220a3 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:36.608078 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-5c48e49d-a003-4404-b968-fe4d4a2220a3 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:36.617068 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-5c48e49d-a003-4404-b968-fe4d4a2220a3 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1362 microversion: 2.1 time: 0.168312 Jul 05 16:09:36.617831 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 76/155] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:36 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:37.041592 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-118f6e0f-ecd0-4650-9049-aeab3428d1e2 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:37.042865 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-118f6e0f-ecd0-4650-9049-aeab3428d1e2 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:37.050430 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-118f6e0f-ecd0-4650-9049-aeab3428d1e2 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:37.051457 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-118f6e0f-ecd0-4650-9049-aeab3428d1e2 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:37.052942 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-118f6e0f-ecd0-4650-9049-aeab3428d1e2 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:37.053565 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-118f6e0f-ecd0-4650-9049-aeab3428d1e2 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:37.063354 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-e019fb06-301a-4a27-bdcd-2013aa923d61 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:37.069022 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-e019fb06-301a-4a27-bdcd-2013aa923d61 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:37.072173 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e019fb06-301a-4a27-bdcd-2013aa923d61 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:37.072920 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e019fb06-301a-4a27-bdcd-2013aa923d61 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:37.073981 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e019fb06-301a-4a27-bdcd-2013aa923d61 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:37.074666 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e019fb06-301a-4a27-bdcd-2013aa923d61 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:37.079476 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=100 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:09:37.721550 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-e019fb06-301a-4a27-bdcd-2013aa923d61 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:37.732682 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-e019fb06-301a-4a27-bdcd-2013aa923d61 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:37.735648 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-e019fb06-301a-4a27-bdcd-2013aa923d61 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:37.739086 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-e019fb06-301a-4a27-bdcd-2013aa923d61 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1406 microversion: 2.20 time: 0.680244 Jul 05 16:09:37.742226 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 77/156] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:09:37 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1406 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:09:37.748012 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-118f6e0f-ecd0-4650-9049-aeab3428d1e2 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89990bfd774417ab0eb52b91ec560d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba872aaf0fd84b1eac87e18659d222d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:37.748301 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-b8c1cfd0-6704-40e6-bb67-abd4e8815fde tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:37.749104 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-b8c1cfd0-6704-40e6-bb67-abd4e8815fde tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:37.758511 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-118f6e0f-ecd0-4650-9049-aeab3428d1e2 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 200 len: 1315 microversion: 2.1 time: 0.722436 Jul 05 16:09:37.761562 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 80/157] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:37 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 1315 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:37.765635 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-e4a1b521-54cb-4327-b400-3d1ae57a70cd tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:37.766459 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-e4a1b521-54cb-4327-b400-3d1ae57a70cd tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:37.767505 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b8c1cfd0-6704-40e6-bb67-abd4e8815fde tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:37.776729 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b8c1cfd0-6704-40e6-bb67-abd4e8815fde tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:37.785438 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b8c1cfd0-6704-40e6-bb67-abd4e8815fde tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:37.785438 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b8c1cfd0-6704-40e6-bb67-abd4e8815fde tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:37.787392 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e4a1b521-54cb-4327-b400-3d1ae57a70cd tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:37.787855 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e4a1b521-54cb-4327-b400-3d1ae57a70cd tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:37.789403 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e4a1b521-54cb-4327-b400-3d1ae57a70cd tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:37.790018 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e4a1b521-54cb-4327-b400-3d1ae57a70cd tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:38.027967 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-e4a1b521-54cb-4327-b400-3d1ae57a70cd tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:38.036630 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-e4a1b521-54cb-4327-b400-3d1ae57a70cd tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1367 microversion: 2.1 time: 0.276320 Jul 05 16:09:38.037257 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 81/158] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:37 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:38.046122 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-a9f16085-9fce-4aff-9482-6fe52180bf90 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:38.046122 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-a9f16085-9fce-4aff-9482-6fe52180bf90 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:38.056677 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a9f16085-9fce-4aff-9482-6fe52180bf90 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:38.061572 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a9f16085-9fce-4aff-9482-6fe52180bf90 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:38.061572 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a9f16085-9fce-4aff-9482-6fe52180bf90 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:38.061763 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-b8c1cfd0-6704-40e6-bb67-abd4e8815fde tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:38.061874 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a9f16085-9fce-4aff-9482-6fe52180bf90 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:38.069605 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-b8c1cfd0-6704-40e6-bb67-abd4e8815fde tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1321 microversion: 2.1 time: 0.326180 Jul 05 16:09:38.070359 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 78/159] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:37 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1321 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:38.197727 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-a9f16085-9fce-4aff-9482-6fe52180bf90 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:38.205404 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-a9f16085-9fce-4aff-9482-6fe52180bf90 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1362 microversion: 2.1 time: 0.167164 Jul 05 16:09:38.205974 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 82/160] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:38 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:38.761239 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-b3536e4f-ccb4-4ba2-ab6b-708e27ef0dce tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:38.762238 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-b3536e4f-ccb4-4ba2-ab6b-708e27ef0dce tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:38.770274 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b3536e4f-ccb4-4ba2-ab6b-708e27ef0dce tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:38.777453 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-830ee243-4863-4864-88dc-5a7a450947d5 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:38.778526 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-830ee243-4863-4864-88dc-5a7a450947d5 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:38.781776 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b3536e4f-ccb4-4ba2-ab6b-708e27ef0dce tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:38.783597 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b3536e4f-ccb4-4ba2-ab6b-708e27ef0dce tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:38.786364 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-830ee243-4863-4864-88dc-5a7a450947d5 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:38.787026 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b3536e4f-ccb4-4ba2-ab6b-708e27ef0dce tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:38.790316 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-830ee243-4863-4864-88dc-5a7a450947d5 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:38.791309 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-830ee243-4863-4864-88dc-5a7a450947d5 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:38.793902 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-830ee243-4863-4864-88dc-5a7a450947d5 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:39.015693 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-b3536e4f-ccb4-4ba2-ab6b-708e27ef0dce tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:39.023881 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-830ee243-4863-4864-88dc-5a7a450947d5 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89990bfd774417ab0eb52b91ec560d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba872aaf0fd84b1eac87e18659d222d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:39.025767 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-b3536e4f-ccb4-4ba2-ab6b-708e27ef0dce tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:39.027471 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-b3536e4f-ccb4-4ba2-ab6b-708e27ef0dce tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:39.028588 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-b3536e4f-ccb4-4ba2-ab6b-708e27ef0dce tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1406 microversion: 2.20 time: 0.273565 Jul 05 16:09:39.029489 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 79/161] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:09:38 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1406 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:09:39.040914 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-830ee243-4863-4864-88dc-5a7a450947d5 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 200 len: 1315 microversion: 2.1 time: 0.268166 Jul 05 16:09:39.041488 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 83/162] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:38 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:39.058640 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-4d05ddf3-d0a8-4336-afd7-bd8d39ad5333 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:39.059468 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-4d05ddf3-d0a8-4336-afd7-bd8d39ad5333 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:39.069329 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4d05ddf3-d0a8-4336-afd7-bd8d39ad5333 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:39.070012 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4d05ddf3-d0a8-4336-afd7-bd8d39ad5333 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:39.072297 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4d05ddf3-d0a8-4336-afd7-bd8d39ad5333 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:39.073518 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4d05ddf3-d0a8-4336-afd7-bd8d39ad5333 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:39.088143 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-366e6fbb-8b64-44ae-9c74-3a3ad2cd8804 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:39.089107 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-366e6fbb-8b64-44ae-9c74-3a3ad2cd8804 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:39.096345 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-366e6fbb-8b64-44ae-9c74-3a3ad2cd8804 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:39.098064 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-366e6fbb-8b64-44ae-9c74-3a3ad2cd8804 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:39.099043 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-366e6fbb-8b64-44ae-9c74-3a3ad2cd8804 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:39.099543 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-366e6fbb-8b64-44ae-9c74-3a3ad2cd8804 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:39.325559 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-366e6fbb-8b64-44ae-9c74-3a3ad2cd8804 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:39.332892 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-366e6fbb-8b64-44ae-9c74-3a3ad2cd8804 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1321 microversion: 2.1 time: 0.250427 Jul 05 16:09:39.340442 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-4d05ddf3-d0a8-4336-afd7-bd8d39ad5333 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:39.341935 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 84/163] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:39 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:39.348740 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-340e4669-d311-4593-9e16-8385082739a5 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:39.349285 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-340e4669-d311-4593-9e16-8385082739a5 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:39.357487 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-4d05ddf3-d0a8-4336-afd7-bd8d39ad5333 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1367 microversion: 2.1 time: 0.303041 Jul 05 16:09:39.357967 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-340e4669-d311-4593-9e16-8385082739a5 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:39.358616 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 80/164] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:39 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1367 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:39.359278 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-340e4669-d311-4593-9e16-8385082739a5 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:39.360391 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-340e4669-d311-4593-9e16-8385082739a5 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:39.360943 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-340e4669-d311-4593-9e16-8385082739a5 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:39.469637 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-c9624e99-fccd-4b6d-af32-08c169a95ba6 req-0d106123-6a79-47b0-a91b-1fe4deb2a2d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57bf131c-eb9d-4831-90e4-078609e6ff06", "name": "network-vif-plugged", "status": "completed", "tag": "54940261-cd96-498a-aea6-233e2ce2bed9"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:09:39.479383 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-c9624e99-fccd-4b6d-af32-08c169a95ba6 req-0d106123-6a79-47b0-a91b-1fe4deb2a2d0 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:39.479973 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-c9624e99-fccd-4b6d-af32-08c169a95ba6 req-0d106123-6a79-47b0-a91b-1fe4deb2a2d0 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:39.491916 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-c9624e99-fccd-4b6d-af32-08c169a95ba6 req-0d106123-6a79-47b0-a91b-1fe4deb2a2d0 service nova] Creating event network-vif-plugged:54940261-cd96-498a-aea6-233e2ce2bed9 for instance 57bf131c-eb9d-4831-90e4-078609e6ff06 on hv-cinder-84875 Jul 05 16:09:39.498668 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-c9624e99-fccd-4b6d-af32-08c169a95ba6 req-0d106123-6a79-47b0-a91b-1fe4deb2a2d0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099626 Jul 05 16:09:39.500116 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 81/165] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:09:39.589178 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-340e4669-d311-4593-9e16-8385082739a5 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:39.594937 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-340e4669-d311-4593-9e16-8385082739a5 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1362 microversion: 2.1 time: 0.251806 Jul 05 16:09:39.595504 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 85/166] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:39 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1362 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:40.047140 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-2253d657-1802-43f1-923a-a628903b5dbb tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:40.047934 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-2253d657-1802-43f1-923a-a628903b5dbb tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:40.054620 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2253d657-1802-43f1-923a-a628903b5dbb tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:40.055200 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2253d657-1802-43f1-923a-a628903b5dbb tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:40.056304 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2253d657-1802-43f1-923a-a628903b5dbb tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:40.056964 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2253d657-1802-43f1-923a-a628903b5dbb tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:40.058051 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-3e3717dd-b3c1-4333-b9f4-aafd2ea8d18e tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:40.058668 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-3e3717dd-b3c1-4333-b9f4-aafd2ea8d18e tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:40.068342 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3e3717dd-b3c1-4333-b9f4-aafd2ea8d18e tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:40.068999 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3e3717dd-b3c1-4333-b9f4-aafd2ea8d18e tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:40.069782 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3e3717dd-b3c1-4333-b9f4-aafd2ea8d18e tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:40.070220 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3e3717dd-b3c1-4333-b9f4-aafd2ea8d18e tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:40.329480 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-2253d657-1802-43f1-923a-a628903b5dbb tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:40.332262 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-3e3717dd-b3c1-4333-b9f4-aafd2ea8d18e tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89990bfd774417ab0eb52b91ec560d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba872aaf0fd84b1eac87e18659d222d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:40.341259 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-3e3717dd-b3c1-4333-b9f4-aafd2ea8d18e tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 200 len: 1315 microversion: 2.1 time: 0.286778 Jul 05 16:09:40.342982 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 86/167] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:40 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:09:40.344915 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-2253d657-1802-43f1-923a-a628903b5dbb tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:40.347169 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-2253d657-1802-43f1-923a-a628903b5dbb tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:40.349717 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-2253d657-1802-43f1-923a-a628903b5dbb tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1406 microversion: 2.20 time: 0.305994 Jul 05 16:09:40.350905 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 82/168] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:09:40 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1406 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:09:40.366767 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-253e9c33-7657-4d59-98db-357a9ecf7bee tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:40.366767 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-253e9c33-7657-4d59-98db-357a9ecf7bee tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:40.368342 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_api:SELECT=100 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:09:40.375066 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-939c6b71-9247-4567-b9e2-1e0ba755bfc9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:40.376050 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-939c6b71-9247-4567-b9e2-1e0ba755bfc9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:40.378699 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_api:SELECT=100 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:09:40.382132 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-939c6b71-9247-4567-b9e2-1e0ba755bfc9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:40.382585 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-939c6b71-9247-4567-b9e2-1e0ba755bfc9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:40.383355 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-939c6b71-9247-4567-b9e2-1e0ba755bfc9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:40.383967 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-939c6b71-9247-4567-b9e2-1e0ba755bfc9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:40.386619 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-253e9c33-7657-4d59-98db-357a9ecf7bee tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:40.387234 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-253e9c33-7657-4d59-98db-357a9ecf7bee tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:40.388064 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-253e9c33-7657-4d59-98db-357a9ecf7bee tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:40.389999 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-253e9c33-7657-4d59-98db-357a9ecf7bee tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:40.608218 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-939c6b71-9247-4567-b9e2-1e0ba755bfc9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:40.617697 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-939c6b71-9247-4567-b9e2-1e0ba755bfc9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1367 microversion: 2.1 time: 0.246149 Jul 05 16:09:40.617918 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-253e9c33-7657-4d59-98db-357a9ecf7bee tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:40.619776 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 83/169] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:40 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:09:40.624907 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-3e8a0820-4fdd-44ab-b0fa-a60af73ff08a tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:40.625687 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-3e8a0820-4fdd-44ab-b0fa-a60af73ff08a tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:40.632386 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3e8a0820-4fdd-44ab-b0fa-a60af73ff08a tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:40.633083 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3e8a0820-4fdd-44ab-b0fa-a60af73ff08a tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:40.634011 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3e8a0820-4fdd-44ab-b0fa-a60af73ff08a tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:40.634600 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3e8a0820-4fdd-44ab-b0fa-a60af73ff08a tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:40.635293 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-253e9c33-7657-4d59-98db-357a9ecf7bee tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1321 microversion: 2.1 time: 0.275866 Jul 05 16:09:40.637136 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 87/170] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:40 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1321 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:40.774455 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-3e8a0820-4fdd-44ab-b0fa-a60af73ff08a tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:40.783833 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-3e8a0820-4fdd-44ab-b0fa-a60af73ff08a tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1362 microversion: 2.1 time: 0.162687 Jul 05 16:09:40.788326 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 84/171] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:40 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:41.358463 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-2ccfd346-9e8b-494a-8fb6-0d2acfa70dc6 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:41.359442 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-2ccfd346-9e8b-494a-8fb6-0d2acfa70dc6 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:41.365988 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2ccfd346-9e8b-494a-8fb6-0d2acfa70dc6 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:41.366441 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2ccfd346-9e8b-494a-8fb6-0d2acfa70dc6 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:41.367200 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2ccfd346-9e8b-494a-8fb6-0d2acfa70dc6 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:41.367634 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2ccfd346-9e8b-494a-8fb6-0d2acfa70dc6 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:41.371899 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-c6c05fe7-d4ac-4b81-b9f9-636c6a4797dc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:41.371899 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-c6c05fe7-d4ac-4b81-b9f9-636c6a4797dc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:41.376579 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c6c05fe7-d4ac-4b81-b9f9-636c6a4797dc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:41.377060 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c6c05fe7-d4ac-4b81-b9f9-636c6a4797dc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:41.377830 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c6c05fe7-d4ac-4b81-b9f9-636c6a4797dc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:41.378266 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c6c05fe7-d4ac-4b81-b9f9-636c6a4797dc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:41.558283 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-2ccfd346-9e8b-494a-8fb6-0d2acfa70dc6 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89990bfd774417ab0eb52b91ec560d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba872aaf0fd84b1eac87e18659d222d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:41.566344 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-2ccfd346-9e8b-494a-8fb6-0d2acfa70dc6 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 200 len: 1315 microversion: 2.1 time: 0.211767 Jul 05 16:09:41.567082 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 88/172] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:41 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:41.572033 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [req-dbdfac9e-437b-4221-b5d5-0081911b9133 req-f84a6bc1-7cc8-4b9e-8f46-4d537de8ea55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4233316e-f948-4729-a298-95bfa8d528da", "name": "network-vif-plugged", "status": "completed", "tag": "0d3daec4-e5f2-405e-a531-5ab8f6778220"}]} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:09:41.579777 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c6c05fe7-d4ac-4b81-b9f9-636c6a4797dc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:41.580187 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-dbdfac9e-437b-4221-b5d5-0081911b9133 req-f84a6bc1-7cc8-4b9e-8f46-4d537de8ea55 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:41.580622 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-dbdfac9e-437b-4221-b5d5-0081911b9133 req-f84a6bc1-7cc8-4b9e-8f46-4d537de8ea55 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:41.588495 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c6c05fe7-d4ac-4b81-b9f9-636c6a4797dc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:41.590375 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c6c05fe7-d4ac-4b81-b9f9-636c6a4797dc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:41.591955 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.compute.server_external_events [req-dbdfac9e-437b-4221-b5d5-0081911b9133 req-f84a6bc1-7cc8-4b9e-8f46-4d537de8ea55 service nova] Creating event network-vif-plugged:0d3daec4-e5f2-405e-a531-5ab8f6778220 for instance 4233316e-f948-4729-a298-95bfa8d528da on hv-cinder-84875 Jul 05 16:09:41.592870 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-c6c05fe7-d4ac-4b81-b9f9-636c6a4797dc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1406 microversion: 2.20 time: 0.226818 Jul 05 16:09:41.593788 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 85/173] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:09:41 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:09:41.597178 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [req-dbdfac9e-437b-4221-b5d5-0081911b9133 req-f84a6bc1-7cc8-4b9e-8f46-4d537de8ea55 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028941 Jul 05 16:09:41.597842 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 89/174] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:09:41.636201 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-190cf6c1-6ffd-43b3-8f69-6416150cd6d7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:41.636850 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-190cf6c1-6ffd-43b3-8f69-6416150cd6d7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:41.646647 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-190cf6c1-6ffd-43b3-8f69-6416150cd6d7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:41.646647 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-190cf6c1-6ffd-43b3-8f69-6416150cd6d7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:41.646647 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-190cf6c1-6ffd-43b3-8f69-6416150cd6d7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:41.646647 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-190cf6c1-6ffd-43b3-8f69-6416150cd6d7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:41.655866 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-eb61c7ae-8b05-40f8-9357-e82df0c2974f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:41.656573 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-eb61c7ae-8b05-40f8-9357-e82df0c2974f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:41.663330 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-eb61c7ae-8b05-40f8-9357-e82df0c2974f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:41.663782 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-eb61c7ae-8b05-40f8-9357-e82df0c2974f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:41.664557 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-eb61c7ae-8b05-40f8-9357-e82df0c2974f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:41.665023 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-eb61c7ae-8b05-40f8-9357-e82df0c2974f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:41.870235 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-eb61c7ae-8b05-40f8-9357-e82df0c2974f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:41.871529 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-190cf6c1-6ffd-43b3-8f69-6416150cd6d7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:41.877489 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-eb61c7ae-8b05-40f8-9357-e82df0c2974f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1321 microversion: 2.1 time: 0.225682 Jul 05 16:09:41.879610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-190cf6c1-6ffd-43b3-8f69-6416150cd6d7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1367 microversion: 2.1 time: 0.248367 Jul 05 16:09:41.880216 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 86/175] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:41 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:41.887193 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 90/176] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:41 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:41.888245 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-b3504b72-5917-43cf-9a83-e0b9b2a12d6a tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:41.888959 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-b3504b72-5917-43cf-9a83-e0b9b2a12d6a tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:41.895078 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b3504b72-5917-43cf-9a83-e0b9b2a12d6a tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:41.896056 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b3504b72-5917-43cf-9a83-e0b9b2a12d6a tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:41.896876 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b3504b72-5917-43cf-9a83-e0b9b2a12d6a tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:41.897353 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b3504b72-5917-43cf-9a83-e0b9b2a12d6a tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:42.034280 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-b3504b72-5917-43cf-9a83-e0b9b2a12d6a tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:42.042405 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-b3504b72-5917-43cf-9a83-e0b9b2a12d6a tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1362 microversion: 2.1 time: 0.161016 Jul 05 16:09:42.042978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 87/177] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:41 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:42.582754 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-bd6c01af-00d3-48c8-a89a-c98d77fce29c tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:42.583343 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-bd6c01af-00d3-48c8-a89a-c98d77fce29c tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:42.589504 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-bd6c01af-00d3-48c8-a89a-c98d77fce29c tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:42.589956 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-bd6c01af-00d3-48c8-a89a-c98d77fce29c tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:42.590737 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-bd6c01af-00d3-48c8-a89a-c98d77fce29c tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:42.591161 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-bd6c01af-00d3-48c8-a89a-c98d77fce29c tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:42.611513 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-61cae2de-4cf8-467a-b6f7-b8bdeaab6218 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:42.616068 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-61cae2de-4cf8-467a-b6f7-b8bdeaab6218 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:42.619432 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-61cae2de-4cf8-467a-b6f7-b8bdeaab6218 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:42.619886 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-61cae2de-4cf8-467a-b6f7-b8bdeaab6218 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:42.620884 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-61cae2de-4cf8-467a-b6f7-b8bdeaab6218 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:42.621246 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-61cae2de-4cf8-467a-b6f7-b8bdeaab6218 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:42.811470 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-bd6c01af-00d3-48c8-a89a-c98d77fce29c tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89990bfd774417ab0eb52b91ec560d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba872aaf0fd84b1eac87e18659d222d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:42.819732 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-bd6c01af-00d3-48c8-a89a-c98d77fce29c tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 200 len: 1315 microversion: 2.1 time: 0.240957 Jul 05 16:09:42.823231 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 91/178] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:42 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:42.824186 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-61cae2de-4cf8-467a-b6f7-b8bdeaab6218 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:42.832751 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-61cae2de-4cf8-467a-b6f7-b8bdeaab6218 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:42.834440 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-61cae2de-4cf8-467a-b6f7-b8bdeaab6218 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:42.835457 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-61cae2de-4cf8-467a-b6f7-b8bdeaab6218 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1406 microversion: 2.20 time: 0.228052 Jul 05 16:09:42.837466 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 88/179] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:09:42 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:09:42.895718 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-83e3bcd8-b14b-4b05-887b-7a795275873a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:42.896338 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-83e3bcd8-b14b-4b05-887b-7a795275873a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:42.903698 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-8b35901c-c1b8-4150-9e38-5e72e20a1fb7 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:42.903860 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-83e3bcd8-b14b-4b05-887b-7a795275873a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:42.903939 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-8b35901c-c1b8-4150-9e38-5e72e20a1fb7 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:42.904034 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-83e3bcd8-b14b-4b05-887b-7a795275873a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:42.905224 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-83e3bcd8-b14b-4b05-887b-7a795275873a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:42.905988 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-83e3bcd8-b14b-4b05-887b-7a795275873a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:42.911959 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8b35901c-c1b8-4150-9e38-5e72e20a1fb7 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:42.914960 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8b35901c-c1b8-4150-9e38-5e72e20a1fb7 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:42.914960 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8b35901c-c1b8-4150-9e38-5e72e20a1fb7 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:42.914960 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8b35901c-c1b8-4150-9e38-5e72e20a1fb7 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:43.124504 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-83e3bcd8-b14b-4b05-887b-7a795275873a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:43.129755 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-83e3bcd8-b14b-4b05-887b-7a795275873a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1367 microversion: 2.1 time: 0.237820 Jul 05 16:09:43.130356 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 89/180] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:42 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:43.131347 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-8b35901c-c1b8-4150-9e38-5e72e20a1fb7 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:43.141255 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-b0486de3-2a5a-49ae-8a50-10ff4b995958 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:43.141690 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-8b35901c-c1b8-4150-9e38-5e72e20a1fb7 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1321 microversion: 2.1 time: 0.250769 Jul 05 16:09:43.141880 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-b0486de3-2a5a-49ae-8a50-10ff4b995958 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:43.142274 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 92/181] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:42 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1321 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:43.149506 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b0486de3-2a5a-49ae-8a50-10ff4b995958 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:43.151277 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b0486de3-2a5a-49ae-8a50-10ff4b995958 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:43.152285 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b0486de3-2a5a-49ae-8a50-10ff4b995958 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:43.158080 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b0486de3-2a5a-49ae-8a50-10ff4b995958 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:43.321643 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-b0486de3-2a5a-49ae-8a50-10ff4b995958 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:43.329429 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-b0486de3-2a5a-49ae-8a50-10ff4b995958 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1362 microversion: 2.1 time: 0.198038 Jul 05 16:09:43.331049 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 90/182] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:43 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:43.631410 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [req-8c432bb6-ce45-462e-a75c-b5179434d190 req-43ee7a91-987f-437a-a348-bd6d721d27fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da368d38-2642-49c3-b499-eb5a977cbd77", "name": "network-vif-plugged", "status": "completed", "tag": "c24636dc-9b24-45b5-a963-180931342e24"}, {"server_uuid": "9b902cfe-0e0b-4ce5-b2df-67ca0464da74", "name": "network-vif-plugged", "status": "completed", "tag": "08ca39e5-59e1-4f7a-887b-ceb7fc9c4671"}]} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:09:43.648995 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-8c432bb6-ce45-462e-a75c-b5179434d190 req-43ee7a91-987f-437a-a348-bd6d721d27fa service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:43.656172 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-8c432bb6-ce45-462e-a75c-b5179434d190 req-43ee7a91-987f-437a-a348-bd6d721d27fa service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:43.682972 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.compute.server_external_events [req-8c432bb6-ce45-462e-a75c-b5179434d190 req-43ee7a91-987f-437a-a348-bd6d721d27fa service nova] Creating event network-vif-plugged:c24636dc-9b24-45b5-a963-180931342e24 for instance da368d38-2642-49c3-b499-eb5a977cbd77 on hv-cinder-84875 Jul 05 16:09:43.684201 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.compute.server_external_events [req-8c432bb6-ce45-462e-a75c-b5179434d190 req-43ee7a91-987f-437a-a348-bd6d721d27fa service nova] Creating event network-vif-plugged:08ca39e5-59e1-4f7a-887b-ceb7fc9c4671 for instance 9b902cfe-0e0b-4ce5-b2df-67ca0464da74 on hv-cinder-84875 Jul 05 16:09:43.693227 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [req-8c432bb6-ce45-462e-a75c-b5179434d190 req-43ee7a91-987f-437a-a348-bd6d721d27fa service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.066151 Jul 05 16:09:43.694041 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 93/183] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:09:43.837884 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-7fce2b03-5803-467a-9512-ac218c3746aa tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:43.840803 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-7fce2b03-5803-467a-9512-ac218c3746aa tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:43.845077 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7fce2b03-5803-467a-9512-ac218c3746aa tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:43.845530 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7fce2b03-5803-467a-9512-ac218c3746aa tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:43.846301 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7fce2b03-5803-467a-9512-ac218c3746aa tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:43.846895 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7fce2b03-5803-467a-9512-ac218c3746aa tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:43.858649 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-c46303e5-2ca4-4f91-87fe-41d95a66b578 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:43.860107 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-c46303e5-2ca4-4f91-87fe-41d95a66b578 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:43.867571 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c46303e5-2ca4-4f91-87fe-41d95a66b578 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:43.868051 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c46303e5-2ca4-4f91-87fe-41d95a66b578 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:43.869169 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c46303e5-2ca4-4f91-87fe-41d95a66b578 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:43.869793 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c46303e5-2ca4-4f91-87fe-41d95a66b578 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:44.077936 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-c46303e5-2ca4-4f91-87fe-41d95a66b578 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:44.082608 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell1:SELECT=100 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:09:44.083654 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-7fce2b03-5803-467a-9512-ac218c3746aa tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89990bfd774417ab0eb52b91ec560d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba872aaf0fd84b1eac87e18659d222d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:44.092252 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-7fce2b03-5803-467a-9512-ac218c3746aa tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 200 len: 1501 microversion: 2.1 time: 0.259385 Jul 05 16:09:44.093176 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-c46303e5-2ca4-4f91-87fe-41d95a66b578 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:44.094603 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 91/184] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:43 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 1501 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:44.096185 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-c46303e5-2ca4-4f91-87fe-41d95a66b578 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:44.098051 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-c46303e5-2ca4-4f91-87fe-41d95a66b578 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1406 microversion: 2.20 time: 0.244354 Jul 05 16:09:44.100978 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 94/185] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:09:43 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1406 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:09:44.149993 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-478b9b7c-7694-45c5-b71b-456190ce41c0 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:44.150770 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-478b9b7c-7694-45c5-b71b-456190ce41c0 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:44.157876 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-63093f13-41f5-4eba-9cdb-088763b4aecd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:44.164339 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-63093f13-41f5-4eba-9cdb-088763b4aecd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:44.164651 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-478b9b7c-7694-45c5-b71b-456190ce41c0 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:44.164651 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-478b9b7c-7694-45c5-b71b-456190ce41c0 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:44.167945 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-63093f13-41f5-4eba-9cdb-088763b4aecd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:44.168565 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-63093f13-41f5-4eba-9cdb-088763b4aecd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:44.169970 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-63093f13-41f5-4eba-9cdb-088763b4aecd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:44.170510 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-63093f13-41f5-4eba-9cdb-088763b4aecd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:44.171728 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-478b9b7c-7694-45c5-b71b-456190ce41c0 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:44.176240 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-478b9b7c-7694-45c5-b71b-456190ce41c0 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:44.531422 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-63093f13-41f5-4eba-9cdb-088763b4aecd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:44.539479 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-63093f13-41f5-4eba-9cdb-088763b4aecd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1321 microversion: 2.1 time: 0.385420 Jul 05 16:09:44.540060 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 95/186] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:44 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1321 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:09:44.545328 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-e065f6f7-f663-4de2-b5d5-caf4c3890857 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:44.546445 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-e065f6f7-f663-4de2-b5d5-caf4c3890857 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:44.553091 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e065f6f7-f663-4de2-b5d5-caf4c3890857 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:44.553534 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e065f6f7-f663-4de2-b5d5-caf4c3890857 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:44.554344 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e065f6f7-f663-4de2-b5d5-caf4c3890857 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:44.554840 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e065f6f7-f663-4de2-b5d5-caf4c3890857 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:44.573490 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-478b9b7c-7694-45c5-b71b-456190ce41c0 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:44.581357 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-478b9b7c-7694-45c5-b71b-456190ce41c0 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1367 microversion: 2.1 time: 0.438157 Jul 05 16:09:44.581941 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 92/187] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:44 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1367 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:44.746820 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-e065f6f7-f663-4de2-b5d5-caf4c3890857 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:44.758352 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-e065f6f7-f663-4de2-b5d5-caf4c3890857 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1362 microversion: 2.1 time: 0.217232 Jul 05 16:09:44.759534 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 96/188] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:44 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:45.125152 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-95a9c0ba-21d1-47af-8a97-3f12f4c00bb2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:45.125767 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-95a9c0ba-21d1-47af-8a97-3f12f4c00bb2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:45.131893 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-95a9c0ba-21d1-47af-8a97-3f12f4c00bb2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:45.132342 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-95a9c0ba-21d1-47af-8a97-3f12f4c00bb2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:45.133130 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-95a9c0ba-21d1-47af-8a97-3f12f4c00bb2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:45.133573 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-95a9c0ba-21d1-47af-8a97-3f12f4c00bb2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:45.274066 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-95a9c0ba-21d1-47af-8a97-3f12f4c00bb2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:45.282383 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-95a9c0ba-21d1-47af-8a97-3f12f4c00bb2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:45.284023 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-95a9c0ba-21d1-47af-8a97-3f12f4c00bb2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:45.285238 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-95a9c0ba-21d1-47af-8a97-3f12f4c00bb2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1406 microversion: 2.20 time: 0.163945 Jul 05 16:09:45.286384 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 93/189] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:09:45 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:09:45.555449 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-488b84b2-7452-48d3-8c2e-902e247d9ee3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:45.556147 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-488b84b2-7452-48d3-8c2e-902e247d9ee3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:45.562225 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-488b84b2-7452-48d3-8c2e-902e247d9ee3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:45.562676 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-488b84b2-7452-48d3-8c2e-902e247d9ee3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:45.563436 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-488b84b2-7452-48d3-8c2e-902e247d9ee3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:45.563874 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-488b84b2-7452-48d3-8c2e-902e247d9ee3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:45.602919 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-b2f28d76-358f-4154-b685-d13d9b8a84d1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:45.603550 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-b2f28d76-358f-4154-b685-d13d9b8a84d1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:45.611628 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b2f28d76-358f-4154-b685-d13d9b8a84d1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:45.612096 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b2f28d76-358f-4154-b685-d13d9b8a84d1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:45.612919 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b2f28d76-358f-4154-b685-d13d9b8a84d1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:45.613372 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b2f28d76-358f-4154-b685-d13d9b8a84d1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:45.634036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=100 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:09:45.745689 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-488b84b2-7452-48d3-8c2e-902e247d9ee3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:45.753337 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-488b84b2-7452-48d3-8c2e-902e247d9ee3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1321 microversion: 2.1 time: 0.201757 Jul 05 16:09:45.753972 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 97/190] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:45 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:45.758369 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [req-6fff7737-477a-4bc3-933d-c731dba481f7 req-3c218ce8-a256-4763-9045-cf9f1ca4f8e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "478dac11-75cf-4e58-9ba7-e78469b8045a", "name": "network-vif-plugged", "status": "completed", "tag": "0d4a05ab-6ac5-4ab2-bad3-8b10a8823738"}, {"server_uuid": "2d712774-90eb-4130-916f-046ba6b891a0", "name": "network-vif-plugged", "status": "completed", "tag": "426e703b-fda9-4cb3-9ba0-62242cbd02d2"}]} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:09:45.767166 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-6fff7737-477a-4bc3-933d-c731dba481f7 req-3c218ce8-a256-4763-9045-cf9f1ca4f8e8 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:45.773522 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-6fff7737-477a-4bc3-933d-c731dba481f7 req-3c218ce8-a256-4763-9045-cf9f1ca4f8e8 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:45.781069 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.compute.server_external_events [req-6fff7737-477a-4bc3-933d-c731dba481f7 req-3c218ce8-a256-4763-9045-cf9f1ca4f8e8 service nova] Creating event network-vif-plugged:0d4a05ab-6ac5-4ab2-bad3-8b10a8823738 for instance 478dac11-75cf-4e58-9ba7-e78469b8045a on hv-cinder-84875 Jul 05 16:09:45.781573 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.compute.server_external_events [req-6fff7737-477a-4bc3-933d-c731dba481f7 req-3c218ce8-a256-4763-9045-cf9f1ca4f8e8 service nova] Creating event network-vif-plugged:426e703b-fda9-4cb3-9ba0-62242cbd02d2 for instance 2d712774-90eb-4130-916f-046ba6b891a0 on hv-cinder-84875 Jul 05 16:09:45.788933 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [req-6fff7737-477a-4bc3-933d-c731dba481f7 req-3c218ce8-a256-4763-9045-cf9f1ca4f8e8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033886 Jul 05 16:09:45.789521 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 98/191] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:09:45.794557 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-692cc7ba-31fa-47c6-b63c-096703c95a38 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:45.795075 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-b2f28d76-358f-4154-b685-d13d9b8a84d1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:45.795624 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-692cc7ba-31fa-47c6-b63c-096703c95a38 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:45.801998 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-692cc7ba-31fa-47c6-b63c-096703c95a38 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:45.802421 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-692cc7ba-31fa-47c6-b63c-096703c95a38 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:45.803180 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-692cc7ba-31fa-47c6-b63c-096703c95a38 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:45.803607 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-692cc7ba-31fa-47c6-b63c-096703c95a38 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:45.805010 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-b2f28d76-358f-4154-b685-d13d9b8a84d1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1367 microversion: 2.1 time: 0.208344 Jul 05 16:09:45.805586 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 94/192] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:45 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:09:45.940012 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-692cc7ba-31fa-47c6-b63c-096703c95a38 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:45.948361 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-692cc7ba-31fa-47c6-b63c-096703c95a38 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1362 microversion: 2.1 time: 0.157558 Jul 05 16:09:45.949150 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 99/193] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:45 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:46.052131 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-ea27e4a0-9311-4740-ab14-3dd97444dab8 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f0d0775-4c5d-423c-be89-0d40bb82620d"}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:09:46.053285 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-ea27e4a0-9311-4740-ab14-3dd97444dab8 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:46.059187 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ea27e4a0-9311-4740-ab14-3dd97444dab8 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:46.059640 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ea27e4a0-9311-4740-ab14-3dd97444dab8 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:46.060402 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ea27e4a0-9311-4740-ab14-3dd97444dab8 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:46.060876 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ea27e4a0-9311-4740-ab14-3dd97444dab8 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:46.304583 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-f34640ad-050b-49c3-9fe7-8c40b455273e tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:46.305266 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-f34640ad-050b-49c3-9fe7-8c40b455273e tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:46.311535 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f34640ad-050b-49c3-9fe7-8c40b455273e tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:46.312044 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f34640ad-050b-49c3-9fe7-8c40b455273e tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:46.312888 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f34640ad-050b-49c3-9fe7-8c40b455273e tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:46.313315 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f34640ad-050b-49c3-9fe7-8c40b455273e tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:46.521820 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-f34640ad-050b-49c3-9fe7-8c40b455273e tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:46.530104 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-f34640ad-050b-49c3-9fe7-8c40b455273e tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:46.535441 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-f34640ad-050b-49c3-9fe7-8c40b455273e tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:46.535441 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-f34640ad-050b-49c3-9fe7-8c40b455273e tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1597 microversion: 2.20 time: 0.233012 Jul 05 16:09:46.535441 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 100/194] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:09:46 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1597 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:09:46.551026 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-51a51756-3d17-4969-a7bb-3490d2b78085 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:46.551944 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-51a51756-3d17-4969-a7bb-3490d2b78085 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:46.558069 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-51a51756-3d17-4969-a7bb-3490d2b78085 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:46.558508 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-51a51756-3d17-4969-a7bb-3490d2b78085 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:46.559267 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-51a51756-3d17-4969-a7bb-3490d2b78085 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:46.560968 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-51a51756-3d17-4969-a7bb-3490d2b78085 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:46.686070 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-51a51756-3d17-4969-a7bb-3490d2b78085 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.139146 Jul 05 16:09:46.686656 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 101/195] 10.222.0.45 () {60 vars in 1315 bytes} [Tue Jul 5 16:09:46 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77/os-interface => generated 284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 05 16:09:46.770406 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-616edd5c-1f4c-4309-8372-d96e8758d3d9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:46.771060 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-616edd5c-1f4c-4309-8372-d96e8758d3d9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:46.777353 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-616edd5c-1f4c-4309-8372-d96e8758d3d9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:46.777834 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-616edd5c-1f4c-4309-8372-d96e8758d3d9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:46.778662 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-616edd5c-1f4c-4309-8372-d96e8758d3d9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:46.779153 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-616edd5c-1f4c-4309-8372-d96e8758d3d9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:47.433001 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-616edd5c-1f4c-4309-8372-d96e8758d3d9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:47.441818 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-616edd5c-1f4c-4309-8372-d96e8758d3d9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1321 microversion: 2.1 time: 0.675430 Jul 05 16:09:47.443082 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 102/196] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:46 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1321 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:09:47.448312 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-b9a001a9-21e8-4816-8d90-7acc5ce32e94 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:47.449011 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-b9a001a9-21e8-4816-8d90-7acc5ce32e94 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:47.455527 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b9a001a9-21e8-4816-8d90-7acc5ce32e94 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:47.455970 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b9a001a9-21e8-4816-8d90-7acc5ce32e94 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:47.456971 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b9a001a9-21e8-4816-8d90-7acc5ce32e94 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:47.457573 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b9a001a9-21e8-4816-8d90-7acc5ce32e94 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:47.652297 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-ea27e4a0-9311-4740-ab14-3dd97444dab8 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "POST /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.603872 Jul 05 16:09:47.656887 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 95/197] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Jul 5 16:09:46 2022] POST /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06/os-volume_attachments => generated 194 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:09:47.658139 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-1b25d409-d782-418a-8c95-15d4768e6499 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:47.658836 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-1b25d409-d782-418a-8c95-15d4768e6499 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:47.665827 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1b25d409-d782-418a-8c95-15d4768e6499 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:47.666273 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1b25d409-d782-418a-8c95-15d4768e6499 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:47.667208 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1b25d409-d782-418a-8c95-15d4768e6499 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:47.667641 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1b25d409-d782-418a-8c95-15d4768e6499 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:47.860860 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-b9a001a9-21e8-4816-8d90-7acc5ce32e94 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:47.872262 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-b9a001a9-21e8-4816-8d90-7acc5ce32e94 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1367 microversion: 2.1 time: 0.427872 Jul 05 16:09:47.873300 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 103/198] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:47 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1367 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:47.983145 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-1b25d409-d782-418a-8c95-15d4768e6499 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:47.994591 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-1b25d409-d782-418a-8c95-15d4768e6499 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1548 microversion: 2.1 time: 0.337711 Jul 05 16:09:47.994591 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 96/199] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:47 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1548 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:48.009588 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-fb86d969-8ea2-48fa-a934-e7534b4e45c7 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:48.010083 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-fb86d969-8ea2-48fa-a934-e7534b4e45c7 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:48.016237 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fb86d969-8ea2-48fa-a934-e7534b4e45c7 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:48.016707 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fb86d969-8ea2-48fa-a934-e7534b4e45c7 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:48.017576 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fb86d969-8ea2-48fa-a934-e7534b4e45c7 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:48.017932 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fb86d969-8ea2-48fa-a934-e7534b4e45c7 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:48.146742 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-fb86d969-8ea2-48fa-a934-e7534b4e45c7 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.141042 Jul 05 16:09:48.147551 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 104/200] 10.222.0.45 () {58 vars in 1274 bytes} [Tue Jul 5 16:09:48 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74/os-interface => generated 285 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:09:48.459957 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-e239502d-810c-4561-aad4-a15a42d118d5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:48.460488 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-e239502d-810c-4561-aad4-a15a42d118d5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:48.466443 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e239502d-810c-4561-aad4-a15a42d118d5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:48.466982 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e239502d-810c-4561-aad4-a15a42d118d5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:48.467749 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e239502d-810c-4561-aad4-a15a42d118d5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:48.468364 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e239502d-810c-4561-aad4-a15a42d118d5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:48.890123 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-1b41e026-c8cc-40d2-8ae0-2ae4a77ce0dd tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:48.890789 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-1b41e026-c8cc-40d2-8ae0-2ae4a77ce0dd tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:48.897430 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1b41e026-c8cc-40d2-8ae0-2ae4a77ce0dd tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:48.898123 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1b41e026-c8cc-40d2-8ae0-2ae4a77ce0dd tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:48.899109 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1b41e026-c8cc-40d2-8ae0-2ae4a77ce0dd tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:48.899724 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1b41e026-c8cc-40d2-8ae0-2ae4a77ce0dd tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:49.124421 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-e239502d-810c-4561-aad4-a15a42d118d5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:49.135021 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-e239502d-810c-4561-aad4-a15a42d118d5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1321 microversion: 2.1 time: 0.679252 Jul 05 16:09:49.135991 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 97/201] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:48 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1321 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:49.301636 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-1b41e026-c8cc-40d2-8ae0-2ae4a77ce0dd tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:49.309724 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-1b41e026-c8cc-40d2-8ae0-2ae4a77ce0dd tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1367 microversion: 2.1 time: 0.423338 Jul 05 16:09:49.310296 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 105/202] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:48 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1367 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:49.403341 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-f564a801-289b-43c3-b2de-5c9767785342 req-b0d8b856-3d26-46f7-bfac-dc0df9dae00d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da368d38-2642-49c3-b499-eb5a977cbd77", "tag": "c24636dc-9b24-45b5-a963-180931342e24"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:09:49.411886 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-f564a801-289b-43c3-b2de-5c9767785342 req-b0d8b856-3d26-46f7-bfac-dc0df9dae00d service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:49.412331 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-f564a801-289b-43c3-b2de-5c9767785342 req-b0d8b856-3d26-46f7-bfac-dc0df9dae00d service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:49.429393 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-f564a801-289b-43c3-b2de-5c9767785342 req-b0d8b856-3d26-46f7-bfac-dc0df9dae00d service nova] Creating event network-changed:c24636dc-9b24-45b5-a963-180931342e24 for instance da368d38-2642-49c3-b499-eb5a977cbd77 on hv-cinder-84875 Jul 05 16:09:49.434808 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-f564a801-289b-43c3-b2de-5c9767785342 req-b0d8b856-3d26-46f7-bfac-dc0df9dae00d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035256 Jul 05 16:09:49.435418 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 98/203] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:09:50.151919 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-b57705c7-ac14-4c0d-b127-7d7c2dc0029a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:50.152526 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-b57705c7-ac14-4c0d-b127-7d7c2dc0029a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:50.168625 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b57705c7-ac14-4c0d-b127-7d7c2dc0029a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:50.176810 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b57705c7-ac14-4c0d-b127-7d7c2dc0029a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:50.177895 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b57705c7-ac14-4c0d-b127-7d7c2dc0029a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:50.178609 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b57705c7-ac14-4c0d-b127-7d7c2dc0029a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:50.334032 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-b3ed14da-b655-4fda-b9a2-66fa6d3cc5e0 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:50.335525 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-b3ed14da-b655-4fda-b9a2-66fa6d3cc5e0 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:50.355416 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b3ed14da-b655-4fda-b9a2-66fa6d3cc5e0 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:50.357707 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b3ed14da-b655-4fda-b9a2-66fa6d3cc5e0 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:50.369743 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b3ed14da-b655-4fda-b9a2-66fa6d3cc5e0 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:50.372147 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b3ed14da-b655-4fda-b9a2-66fa6d3cc5e0 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:50.393327 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-b57705c7-ac14-4c0d-b127-7d7c2dc0029a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:50.402126 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-b57705c7-ac14-4c0d-b127-7d7c2dc0029a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1515 microversion: 2.1 time: 0.253978 Jul 05 16:09:50.403263 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 106/204] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:50 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1515 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:50.419857 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-481ceeef-67ad-4e93-a683-f8f4769587cd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:09:50.428147 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-481ceeef-67ad-4e93-a683-f8f4769587cd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:50.434272 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-481ceeef-67ad-4e93-a683-f8f4769587cd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:50.434943 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-481ceeef-67ad-4e93-a683-f8f4769587cd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:50.435874 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-481ceeef-67ad-4e93-a683-f8f4769587cd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:50.436454 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-481ceeef-67ad-4e93-a683-f8f4769587cd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:50.463686 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.objects.instance [None req-481ceeef-67ad-4e93-a683-f8f4769587cd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lazy-loading 'flavor' on Instance uuid 2d712774-90eb-4130-916f-046ba6b891a0 {{(pid=118319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 16:09:50.825883 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-b3ed14da-b655-4fda-b9a2-66fa6d3cc5e0 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:50.836355 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-b3ed14da-b655-4fda-b9a2-66fa6d3cc5e0 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1557 microversion: 2.1 time: 0.514010 Jul 05 16:09:50.866759 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 99/205] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:50 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1557 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:50.871675 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-bd206563-d1e2-4d67-859b-2193fb9b6701 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:50.872240 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-bd206563-d1e2-4d67-859b-2193fb9b6701 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:50.879874 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bd206563-d1e2-4d67-859b-2193fb9b6701 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:50.880333 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bd206563-d1e2-4d67-859b-2193fb9b6701 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:50.881135 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bd206563-d1e2-4d67-859b-2193fb9b6701 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:50.881565 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bd206563-d1e2-4d67-859b-2193fb9b6701 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:50.977166 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-481ceeef-67ad-4e93-a683-f8f4769587cd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "POST /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0/action" status: 200 len: 32 microversion: 2.1 time: 0.561082 Jul 05 16:09:50.978018 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 107/206] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Jul 5 16:09:50 2022] POST /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0/action => generated 32 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 16:09:50.988731 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-8ef0ffd1-f3b9-4f01-80e9-7d375363c940 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:50.989457 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-8ef0ffd1-f3b9-4f01-80e9-7d375363c940 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:51.001820 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8ef0ffd1-f3b9-4f01-80e9-7d375363c940 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:51.008688 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8ef0ffd1-f3b9-4f01-80e9-7d375363c940 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:51.008688 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8ef0ffd1-f3b9-4f01-80e9-7d375363c940 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:51.008923 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-bd206563-d1e2-4d67-859b-2193fb9b6701 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.138047 Jul 05 16:09:51.009001 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8ef0ffd1-f3b9-4f01-80e9-7d375363c940 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:51.009075 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 100/207] 10.222.0.45 () {58 vars in 1274 bytes} [Tue Jul 5 16:09:50 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a/os-interface => generated 284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:09:51.495776 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-437c8ce7-8434-4a15-a017-de8316e88ea7 req-7a44d56f-9a63-4db3-8b26-e77667c5427c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b902cfe-0e0b-4ce5-b2df-67ca0464da74", "tag": "08ca39e5-59e1-4f7a-887b-ceb7fc9c4671"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:09:51.512449 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-437c8ce7-8434-4a15-a017-de8316e88ea7 req-7a44d56f-9a63-4db3-8b26-e77667c5427c service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:51.513180 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-437c8ce7-8434-4a15-a017-de8316e88ea7 req-7a44d56f-9a63-4db3-8b26-e77667c5427c service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:51.539645 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-437c8ce7-8434-4a15-a017-de8316e88ea7 req-7a44d56f-9a63-4db3-8b26-e77667c5427c service nova] Creating event network-changed:08ca39e5-59e1-4f7a-887b-ceb7fc9c4671 for instance 9b902cfe-0e0b-4ce5-b2df-67ca0464da74 on hv-cinder-84875 Jul 05 16:09:51.545311 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-437c8ce7-8434-4a15-a017-de8316e88ea7 req-7a44d56f-9a63-4db3-8b26-e77667c5427c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053990 Jul 05 16:09:51.546389 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 101/208] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:09:51.765202 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-8ef0ffd1-f3b9-4f01-80e9-7d375363c940 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:51.777796 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-8ef0ffd1-f3b9-4f01-80e9-7d375363c940 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1521 microversion: 2.1 time: 0.793556 Jul 05 16:09:51.778554 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 108/209] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:50 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1521 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:09:52.802640 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-33881f3f-0544-4355-8ab1-4313bbe59c67 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:52.803320 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-33881f3f-0544-4355-8ab1-4313bbe59c67 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:52.809731 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-33881f3f-0544-4355-8ab1-4313bbe59c67 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:52.810177 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-33881f3f-0544-4355-8ab1-4313bbe59c67 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:52.811193 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-33881f3f-0544-4355-8ab1-4313bbe59c67 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:52.811709 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-33881f3f-0544-4355-8ab1-4313bbe59c67 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:53.349981 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-33881f3f-0544-4355-8ab1-4313bbe59c67 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:53.357731 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-33881f3f-0544-4355-8ab1-4313bbe59c67 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1521 microversion: 2.1 time: 0.559727 Jul 05 16:09:53.358296 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 102/210] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:52 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1521 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:53.643636 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [req-a68b3dc2-e2f4-48fb-9b18-af549ad7725a req-b4dd7015-88f3-4353-ba64-c219f855d02d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "478dac11-75cf-4e58-9ba7-e78469b8045a", "tag": "0d4a05ab-6ac5-4ab2-bad3-8b10a8823738"}]} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:09:53.651787 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-a68b3dc2-e2f4-48fb-9b18-af549ad7725a req-b4dd7015-88f3-4353-ba64-c219f855d02d service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:53.652221 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-a68b3dc2-e2f4-48fb-9b18-af549ad7725a req-b4dd7015-88f3-4353-ba64-c219f855d02d service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:53.663309 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.compute.server_external_events [req-a68b3dc2-e2f4-48fb-9b18-af549ad7725a req-b4dd7015-88f3-4353-ba64-c219f855d02d service nova] Creating event network-changed:0d4a05ab-6ac5-4ab2-bad3-8b10a8823738 for instance 478dac11-75cf-4e58-9ba7-e78469b8045a on hv-cinder-84875 Jul 05 16:09:53.668188 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [req-a68b3dc2-e2f4-48fb-9b18-af549ad7725a req-b4dd7015-88f3-4353-ba64-c219f855d02d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028375 Jul 05 16:09:53.668825 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 109/211] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:09:54.380878 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-c6e8aaf4-3027-410d-ab52-2965a81701ca tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:54.381500 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-c6e8aaf4-3027-410d-ab52-2965a81701ca tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:54.388225 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c6e8aaf4-3027-410d-ab52-2965a81701ca tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:54.388896 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c6e8aaf4-3027-410d-ab52-2965a81701ca tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:54.389888 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c6e8aaf4-3027-410d-ab52-2965a81701ca tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:54.390904 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c6e8aaf4-3027-410d-ab52-2965a81701ca tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:54.613031 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c6e8aaf4-3027-410d-ab52-2965a81701ca tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:54.623591 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-c6e8aaf4-3027-410d-ab52-2965a81701ca tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1521 microversion: 2.1 time: 0.251898 Jul 05 16:09:54.630331 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 103/212] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:54 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:55.641800 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-09729274-55dd-4601-a8fb-e166ea0c085f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:55.642479 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-09729274-55dd-4601-a8fb-e166ea0c085f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:55.648523 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-09729274-55dd-4601-a8fb-e166ea0c085f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:55.648993 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-09729274-55dd-4601-a8fb-e166ea0c085f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:55.649750 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-09729274-55dd-4601-a8fb-e166ea0c085f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:55.650178 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-09729274-55dd-4601-a8fb-e166ea0c085f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:55.887834 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-09729274-55dd-4601-a8fb-e166ea0c085f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:55.896158 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-09729274-55dd-4601-a8fb-e166ea0c085f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1521 microversion: 2.1 time: 0.258633 Jul 05 16:09:55.897030 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 110/213] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:55 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:56.912669 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-70596727-0f95-433e-8b00-72835a104475 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:56.913343 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-70596727-0f95-433e-8b00-72835a104475 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:56.920222 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-70596727-0f95-433e-8b00-72835a104475 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:56.920678 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-70596727-0f95-433e-8b00-72835a104475 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:56.921491 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-70596727-0f95-433e-8b00-72835a104475 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:56.922037 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-70596727-0f95-433e-8b00-72835a104475 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:57.058745 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-70596727-0f95-433e-8b00-72835a104475 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:57.069802 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-70596727-0f95-433e-8b00-72835a104475 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1521 microversion: 2.1 time: 0.160753 Jul 05 16:09:57.070691 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 104/214] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:56 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:58.087042 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-dbd56b57-4ea5-4616-9583-faf3a1b434a7 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:58.092317 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-dbd56b57-4ea5-4616-9583-faf3a1b434a7 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:58.093849 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-dbd56b57-4ea5-4616-9583-faf3a1b434a7 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:58.094319 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-dbd56b57-4ea5-4616-9583-faf3a1b434a7 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:58.095056 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-dbd56b57-4ea5-4616-9583-faf3a1b434a7 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:58.095513 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-dbd56b57-4ea5-4616-9583-faf3a1b434a7 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:58.116889 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:09:58.235055 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-dbd56b57-4ea5-4616-9583-faf3a1b434a7 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:58.243725 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-dbd56b57-4ea5-4616-9583-faf3a1b434a7 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1521 microversion: 2.1 time: 0.161133 Jul 05 16:09:58.244354 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 111/215] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:58 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:09:59.260272 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-5ef985b9-add6-40c9-ae92-3a43c813a53f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:09:59.260915 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-5ef985b9-add6-40c9-ae92-3a43c813a53f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:09:59.267025 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5ef985b9-add6-40c9-ae92-3a43c813a53f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:59.267477 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5ef985b9-add6-40c9-ae92-3a43c813a53f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:59.268243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5ef985b9-add6-40c9-ae92-3a43c813a53f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:09:59.268995 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5ef985b9-add6-40c9-ae92-3a43c813a53f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:09:59.404858 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-5ef985b9-add6-40c9-ae92-3a43c813a53f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:09:59.412612 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-5ef985b9-add6-40c9-ae92-3a43c813a53f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1521 microversion: 2.1 time: 0.155939 Jul 05 16:09:59.413340 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 105/216] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:09:59 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:00.435734 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-01d63c5c-9280-4850-804e-9c0137ce7772 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:00.435734 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-01d63c5c-9280-4850-804e-9c0137ce7772 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:00.436475 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-01d63c5c-9280-4850-804e-9c0137ce7772 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:00.436961 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-01d63c5c-9280-4850-804e-9c0137ce7772 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:00.437725 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-01d63c5c-9280-4850-804e-9c0137ce7772 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:00.438167 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-01d63c5c-9280-4850-804e-9c0137ce7772 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:00.567180 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-01d63c5c-9280-4850-804e-9c0137ce7772 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:00.574770 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-01d63c5c-9280-4850-804e-9c0137ce7772 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1521 microversion: 2.1 time: 0.149707 Jul 05 16:10:00.575341 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 112/217] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:00 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:01.591338 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-0c5c22cf-2f83-4dae-a9c7-e38850e913d6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:01.596964 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-0c5c22cf-2f83-4dae-a9c7-e38850e913d6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:01.599410 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0c5c22cf-2f83-4dae-a9c7-e38850e913d6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:01.599858 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0c5c22cf-2f83-4dae-a9c7-e38850e913d6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:01.600621 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0c5c22cf-2f83-4dae-a9c7-e38850e913d6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:01.601085 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0c5c22cf-2f83-4dae-a9c7-e38850e913d6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:01.750047 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-0c5c22cf-2f83-4dae-a9c7-e38850e913d6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:01.757952 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-0c5c22cf-2f83-4dae-a9c7-e38850e913d6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1521 microversion: 2.1 time: 0.170535 Jul 05 16:10:01.758530 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 106/218] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:01 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:02.775301 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-ed081ce6-2a0e-4164-ad9b-e808ff9853bd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:02.775916 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-ed081ce6-2a0e-4164-ad9b-e808ff9853bd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:02.781982 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ed081ce6-2a0e-4164-ad9b-e808ff9853bd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:02.782430 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ed081ce6-2a0e-4164-ad9b-e808ff9853bd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:02.783182 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ed081ce6-2a0e-4164-ad9b-e808ff9853bd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:02.783619 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ed081ce6-2a0e-4164-ad9b-e808ff9853bd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:02.916903 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-ed081ce6-2a0e-4164-ad9b-e808ff9853bd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:02.924637 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-ed081ce6-2a0e-4164-ad9b-e808ff9853bd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1521 microversion: 2.1 time: 0.153189 Jul 05 16:10:02.925246 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 113/219] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:02 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:03.943009 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-7d1ebf14-8f3a-4c27-a6e6-41ee019bd62e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:03.944632 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-7d1ebf14-8f3a-4c27-a6e6-41ee019bd62e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:03.952059 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7d1ebf14-8f3a-4c27-a6e6-41ee019bd62e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:03.952879 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7d1ebf14-8f3a-4c27-a6e6-41ee019bd62e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:03.953710 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7d1ebf14-8f3a-4c27-a6e6-41ee019bd62e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:03.954419 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7d1ebf14-8f3a-4c27-a6e6-41ee019bd62e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:04.093877 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-7d1ebf14-8f3a-4c27-a6e6-41ee019bd62e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:04.101815 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-7d1ebf14-8f3a-4c27-a6e6-41ee019bd62e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1521 microversion: 2.1 time: 0.163015 Jul 05 16:10:04.102392 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 107/220] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:03 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:05.008500 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-0f473cf1-bcce-4d69-a557-6c0d628bf9d2 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:05.009147 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-0f473cf1-bcce-4d69-a557-6c0d628bf9d2 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:05.015480 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0f473cf1-bcce-4d69-a557-6c0d628bf9d2 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:05.015929 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0f473cf1-bcce-4d69-a557-6c0d628bf9d2 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:05.016703 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0f473cf1-bcce-4d69-a557-6c0d628bf9d2 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:05.017178 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0f473cf1-bcce-4d69-a557-6c0d628bf9d2 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:05.043398 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-0f473cf1-bcce-4d69-a557-6c0d628bf9d2 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Going to try to terminate instance {{(pid=118319) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 16:10:05.119321 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-21db1afd-78bb-4df1-9ec0-be5d198130b6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:05.119929 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-21db1afd-78bb-4df1-9ec0-be5d198130b6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:05.126548 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-21db1afd-78bb-4df1-9ec0-be5d198130b6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:05.126998 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-21db1afd-78bb-4df1-9ec0-be5d198130b6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:05.128032 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-21db1afd-78bb-4df1-9ec0-be5d198130b6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:05.128471 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-21db1afd-78bb-4df1-9ec0-be5d198130b6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:05.263878 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-21db1afd-78bb-4df1-9ec0-be5d198130b6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:05.271452 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-21db1afd-78bb-4df1-9ec0-be5d198130b6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1521 microversion: 2.1 time: 0.155898 Jul 05 16:10:05.273070 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 108/221] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:05 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:10:05.380272 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-0f473cf1-bcce-4d69-a557-6c0d628bf9d2 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "DELETE /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 204 len: 0 microversion: 2.1 time: 0.375613 Jul 05 16:10:05.381449 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 114/222] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Jul 5 16:10:05 2022] DELETE /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 16:10:05.397382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-76ea42c1-f984-483a-a2d5-5dde06004db7 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:05.397382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-76ea42c1-f984-483a-a2d5-5dde06004db7 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:05.397382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-76ea42c1-f984-483a-a2d5-5dde06004db7 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:05.397902 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-76ea42c1-f984-483a-a2d5-5dde06004db7 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:05.398752 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-76ea42c1-f984-483a-a2d5-5dde06004db7 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:05.399251 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-76ea42c1-f984-483a-a2d5-5dde06004db7 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:05.545961 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-76ea42c1-f984-483a-a2d5-5dde06004db7 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89990bfd774417ab0eb52b91ec560d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba872aaf0fd84b1eac87e18659d222d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:05.558037 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-76ea42c1-f984-483a-a2d5-5dde06004db7 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 200 len: 1553 microversion: 2.1 time: 0.172153 Jul 05 16:10:05.558625 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 109/223] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:05 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 1553 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:06.289397 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-a1c2ea9e-9287-4e3c-884a-ab0b6db5ae09 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:06.290087 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-a1c2ea9e-9287-4e3c-884a-ab0b6db5ae09 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:06.296482 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a1c2ea9e-9287-4e3c-884a-ab0b6db5ae09 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:06.297429 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a1c2ea9e-9287-4e3c-884a-ab0b6db5ae09 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:06.298383 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a1c2ea9e-9287-4e3c-884a-ab0b6db5ae09 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:06.298813 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a1c2ea9e-9287-4e3c-884a-ab0b6db5ae09 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:06.444063 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-a1c2ea9e-9287-4e3c-884a-ab0b6db5ae09 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:06.450439 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-a1c2ea9e-9287-4e3c-884a-ab0b6db5ae09 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1521 microversion: 2.1 time: 0.165324 Jul 05 16:10:06.451010 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 115/224] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:06 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:06.575624 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-7d0e417a-36b9-4ff4-b8b8-6e9df6b7e75b tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:06.576113 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-7d0e417a-36b9-4ff4-b8b8-6e9df6b7e75b tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:06.582555 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7d0e417a-36b9-4ff4-b8b8-6e9df6b7e75b tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:06.583003 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7d0e417a-36b9-4ff4-b8b8-6e9df6b7e75b tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:06.583771 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7d0e417a-36b9-4ff4-b8b8-6e9df6b7e75b tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:06.584216 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7d0e417a-36b9-4ff4-b8b8-6e9df6b7e75b tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:06.722605 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-7d0e417a-36b9-4ff4-b8b8-6e9df6b7e75b tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89990bfd774417ab0eb52b91ec560d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba872aaf0fd84b1eac87e18659d222d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:06.730811 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-7d0e417a-36b9-4ff4-b8b8-6e9df6b7e75b tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 200 len: 1553 microversion: 2.1 time: 0.159091 Jul 05 16:10:06.731422 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 110/225] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:06 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:07.467317 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-311ea4da-e17d-46b6-bccb-b1850b6413d4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:07.467929 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-311ea4da-e17d-46b6-bccb-b1850b6413d4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:07.473908 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-311ea4da-e17d-46b6-bccb-b1850b6413d4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:07.474360 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-311ea4da-e17d-46b6-bccb-b1850b6413d4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:07.475746 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-311ea4da-e17d-46b6-bccb-b1850b6413d4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:07.476220 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-311ea4da-e17d-46b6-bccb-b1850b6413d4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:07.610877 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-311ea4da-e17d-46b6-bccb-b1850b6413d4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:07.618288 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-311ea4da-e17d-46b6-bccb-b1850b6413d4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1521 microversion: 2.1 time: 0.154972 Jul 05 16:10:07.618864 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 116/226] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:07 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:07.748559 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-5538958e-00f2-4fd9-b91f-7b652c7ce1c8 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:07.749139 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-5538958e-00f2-4fd9-b91f-7b652c7ce1c8 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:07.755656 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5538958e-00f2-4fd9-b91f-7b652c7ce1c8 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:07.756108 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5538958e-00f2-4fd9-b91f-7b652c7ce1c8 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:07.757687 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5538958e-00f2-4fd9-b91f-7b652c7ce1c8 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:07.758181 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5538958e-00f2-4fd9-b91f-7b652c7ce1c8 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:07.777292 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:10:07.892705 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-5538958e-00f2-4fd9-b91f-7b652c7ce1c8 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89990bfd774417ab0eb52b91ec560d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba872aaf0fd84b1eac87e18659d222d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:07.901512 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-5538958e-00f2-4fd9-b91f-7b652c7ce1c8 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 200 len: 1553 microversion: 2.1 time: 0.156803 Jul 05 16:10:07.902089 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 111/227] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:07 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:08.652502 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-09c2a606-470e-4c55-8374-ddb5c32a84ff tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:08.653136 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-09c2a606-470e-4c55-8374-ddb5c32a84ff tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:08.667096 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-09c2a606-470e-4c55-8374-ddb5c32a84ff tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:08.667555 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-09c2a606-470e-4c55-8374-ddb5c32a84ff tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:08.668331 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-09c2a606-470e-4c55-8374-ddb5c32a84ff tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:08.668771 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-09c2a606-470e-4c55-8374-ddb5c32a84ff tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:08.821261 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-09c2a606-470e-4c55-8374-ddb5c32a84ff tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:08.829528 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-09c2a606-470e-4c55-8374-ddb5c32a84ff tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1521 microversion: 2.1 time: 0.194635 Jul 05 16:10:08.830150 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 117/228] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:08 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:08.928598 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-db00d596-3b14-47ee-9324-2ea8eef447e1 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:08.930788 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-db00d596-3b14-47ee-9324-2ea8eef447e1 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:08.946603 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [req-9f11a654-cc1a-4af2-ad5b-5fa51d23f9c2 req-08302b89-dc52-499f-be98-4b0052ff53ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57bf131c-eb9d-4831-90e4-078609e6ff06", "name": "network-vif-deleted", "tag": "54940261-cd96-498a-aea6-233e2ce2bed9"}]} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:10:08.952757 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-db00d596-3b14-47ee-9324-2ea8eef447e1 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:08.952757 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-db00d596-3b14-47ee-9324-2ea8eef447e1 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:08.952757 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-db00d596-3b14-47ee-9324-2ea8eef447e1 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:08.952757 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-db00d596-3b14-47ee-9324-2ea8eef447e1 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:08.955688 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-9f11a654-cc1a-4af2-ad5b-5fa51d23f9c2 req-08302b89-dc52-499f-be98-4b0052ff53ee service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:08.956141 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-9f11a654-cc1a-4af2-ad5b-5fa51d23f9c2 req-08302b89-dc52-499f-be98-4b0052ff53ee service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:08.970443 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.compute.server_external_events [req-9f11a654-cc1a-4af2-ad5b-5fa51d23f9c2 req-08302b89-dc52-499f-be98-4b0052ff53ee service nova] Creating event network-vif-deleted:54940261-cd96-498a-aea6-233e2ce2bed9 for instance 57bf131c-eb9d-4831-90e4-078609e6ff06 on hv-cinder-84875 Jul 05 16:10:08.978098 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [req-9f11a654-cc1a-4af2-ad5b-5fa51d23f9c2 req-08302b89-dc52-499f-be98-4b0052ff53ee service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034342 Jul 05 16:10:08.982348 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 118/229] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:10:09.043754 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-db00d596-3b14-47ee-9324-2ea8eef447e1 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89990bfd774417ab0eb52b91ec560d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba872aaf0fd84b1eac87e18659d222d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:09.053178 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-db00d596-3b14-47ee-9324-2ea8eef447e1 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 200 len: 1511 microversion: 2.1 time: 0.137334 Jul 05 16:10:09.054095 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 112/230] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:08 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 1511 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:10:09.848355 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-f7049156-593a-46f5-9d01-a838c8d86491 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:09.849142 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-f7049156-593a-46f5-9d01-a838c8d86491 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:09.855921 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f7049156-593a-46f5-9d01-a838c8d86491 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:09.856462 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f7049156-593a-46f5-9d01-a838c8d86491 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:09.857249 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f7049156-593a-46f5-9d01-a838c8d86491 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:09.857683 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f7049156-593a-46f5-9d01-a838c8d86491 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:09.993229 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-f7049156-593a-46f5-9d01-a838c8d86491 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:10.000676 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-f7049156-593a-46f5-9d01-a838c8d86491 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1521 microversion: 2.1 time: 0.156713 Jul 05 16:10:10.001226 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 119/231] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:09 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:10.075747 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-7c5d16bd-4cdc-4cef-89fd-faec7df69b9b tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:10.076369 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-7c5d16bd-4cdc-4cef-89fd-faec7df69b9b tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:10.082911 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7c5d16bd-4cdc-4cef-89fd-faec7df69b9b tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:10.085227 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7c5d16bd-4cdc-4cef-89fd-faec7df69b9b tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:10.085227 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7c5d16bd-4cdc-4cef-89fd-faec7df69b9b tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:10.085227 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7c5d16bd-4cdc-4cef-89fd-faec7df69b9b tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:10.118959 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7c5d16bd-4cdc-4cef-89fd-faec7df69b9b tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:10.119400 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7c5d16bd-4cdc-4cef-89fd-faec7df69b9b tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:10.119861 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.objects.instance [None req-7c5d16bd-4cdc-4cef-89fd-faec7df69b9b tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lazy-loading 'fault' on Instance uuid 57bf131c-eb9d-4831-90e4-078609e6ff06 {{(pid=118320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 16:10:10.166076 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-7c5d16bd-4cdc-4cef-89fd-faec7df69b9b tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89990bfd774417ab0eb52b91ec560d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba872aaf0fd84b1eac87e18659d222d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:10.173965 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-7c5d16bd-4cdc-4cef-89fd-faec7df69b9b tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 200 len: 1351 microversion: 2.1 time: 0.103622 Jul 05 16:10:10.174528 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 113/232] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:10 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 1351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:11.017599 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-3cb0b580-a6ec-4a98-bee9-3501ba915111 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:11.018205 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-3cb0b580-a6ec-4a98-bee9-3501ba915111 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:11.020180 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:10:11.025064 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3cb0b580-a6ec-4a98-bee9-3501ba915111 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:11.025492 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3cb0b580-a6ec-4a98-bee9-3501ba915111 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:11.026240 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3cb0b580-a6ec-4a98-bee9-3501ba915111 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:11.026671 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3cb0b580-a6ec-4a98-bee9-3501ba915111 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:11.164114 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-3cb0b580-a6ec-4a98-bee9-3501ba915111 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:11.172471 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-3cb0b580-a6ec-4a98-bee9-3501ba915111 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1521 microversion: 2.1 time: 0.158615 Jul 05 16:10:11.173157 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 120/233] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:11 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:11.191770 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-fa9cb1d8-64ec-47a7-8160-4d5c1299bb1a tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:11.192399 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-fa9cb1d8-64ec-47a7-8160-4d5c1299bb1a tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:11.194932 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_api:SELECT=63 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:10:11.200268 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fa9cb1d8-64ec-47a7-8160-4d5c1299bb1a tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:11.200721 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fa9cb1d8-64ec-47a7-8160-4d5c1299bb1a tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:11.201521 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fa9cb1d8-64ec-47a7-8160-4d5c1299bb1a tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:11.202101 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fa9cb1d8-64ec-47a7-8160-4d5c1299bb1a tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:11.217358 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-fa9cb1d8-64ec-47a7-8160-4d5c1299bb1a tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] HTTP exception thrown: Instance 57bf131c-eb9d-4831-90e4-078609e6ff06 could not be found. Jul 05 16:10:11.222242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-fa9cb1d8-64ec-47a7-8160-4d5c1299bb1a tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Request method failure captured: Jul 05 16:10:11.222242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 HTTP/1.1 Jul 05 16:10:11.222242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:10:11.222242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:10:11.222242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:10:11.222242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:10:11.222242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:10:11.222242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:10:11.222242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:10:11.222242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:10:11.222242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIZjiO3SMQU_kTzoiC-3Fw0DrC1MQwXBX0ACbkh2JJJ2U2XP5yzGdLhAKiBzbGCqxXn1G1RZZ5AKDYwKXE0My4Fy3qrmdBvFrqy6Q7FWKJatRQWi371tXIwqJHirdH2PKxxy_7MGJxAtroiTJ0F6Do5ynOEYKirg3hoDSsgrinK2Jc Jul 05 16:10:11.222242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:10:11.222242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:10:11.222242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:10:11.222242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:10:11.222242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:10:11.222242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:10:11.222242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: ba872aaf0fd84b1eac87e18659d222d5 Jul 05 16:10:11.222242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-DeleteServersTestJSON-275421852 Jul 05 16:10:11.222242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:10:11.222242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:10:11.223753 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ba872aaf0fd84b1eac87e18659d222d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ba872aaf0fd84b1eac87e18659d222d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ba872aaf0fd84b1eac87e18659d222d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ba872aaf0fd84b1eac87e18659d222d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:10:11.223753 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-DeleteServersTestJSON-275421852 Jul 05 16:10:11.223753 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: ba872aaf0fd84b1eac87e18659d222d5 Jul 05 16:10:11.223753 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-DeleteServersTestJSON-275421852 Jul 05 16:10:11.223753 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-DeleteServersTestJSON-275421852-project Jul 05 16:10:11.223753 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:10:11.223753 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:10:11.223753 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: d89990bfd774417ab0eb52b91ec560d8 Jul 05 16:10:11.223753 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-DeleteServersTestJSON-275421852-project Jul 05 16:10:11.223753 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:10:11.223753 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance 57bf131c-eb9d-4831-90e4-078609e6ff06 could not be found. Jul 05 16:10:11.223753 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': '57bf131c-eb9d-4831-90e4-078609e6ff06'} Jul 05 16:10:11.224648 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:10:11.224648 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:10:11.224648 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:10:11.224648 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:10:11.224648 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:10:11.224648 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:10:11.224648 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:10:11.224648 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:10:11.224648 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:10:11.224648 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:10:11.224648 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57bf131c-eb9d-4831-90e4-078609e6ff06 could not be found. Jul 05 16:10:11.224648 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:10:11.224648 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:10:11.224648 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:10:11.224648 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:10:11.224648 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:10:11.224648 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:10:11.224648 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:10:11.224648 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:10:11.224648 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:10:11.226525 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:10:11.226525 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 16:10:11.226525 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 16:10:11.226525 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:10:11.226525 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:10:11.226525 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:10:11.226525 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:10:11.226525 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57bf131c-eb9d-4831-90e4-078609e6ff06 could not be found. Jul 05 16:10:11.226525 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:10:11.226525 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:10:11.226525 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:10:11.226525 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:10:11.226525 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:10:11.226525 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:10:11.226525 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:10:11.226525 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:10:11.226525 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57bf131c-eb9d-4831-90e4-078609e6ff06 could not be found. Jul 05 16:10:11.226525 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:10:11.227496 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-fa9cb1d8-64ec-47a7-8160-4d5c1299bb1a tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Returning 404 to user: Instance 57bf131c-eb9d-4831-90e4-078609e6ff06 could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:10:11.227496 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-fa9cb1d8-64ec-47a7-8160-4d5c1299bb1a tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 404 len: 111 microversion: 2.1 time: 0.036399 Jul 05 16:10:11.227496 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 114/234] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:11 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 16:10:11.332282 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-d4192549-0f15-4916-a75c-f6fc8197dad6 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:11.332282 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-d4192549-0f15-4916-a75c-f6fc8197dad6 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:11.337073 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d4192549-0f15-4916-a75c-f6fc8197dad6 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:11.337522 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d4192549-0f15-4916-a75c-f6fc8197dad6 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:11.338317 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d4192549-0f15-4916-a75c-f6fc8197dad6 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:11.338750 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d4192549-0f15-4916-a75c-f6fc8197dad6 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:11.351882 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.wsgi [None req-d4192549-0f15-4916-a75c-f6fc8197dad6 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] HTTP exception thrown: Instance 57bf131c-eb9d-4831-90e4-078609e6ff06 could not be found. Jul 05 16:10:11.356176 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-d4192549-0f15-4916-a75c-f6fc8197dad6 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Request method failure captured: Jul 05 16:10:11.356176 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: request: GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06/os-volume_attachments HTTP/1.1 Jul 05 16:10:11.356176 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Accept: application/json Jul 05 16:10:11.356176 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Accept-Encoding: identity Jul 05 16:10:11.356176 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Connection: close Jul 05 16:10:11.356176 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Content-Length: 0 Jul 05 16:10:11.356176 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Content-Type: application/json Jul 05 16:10:11.356176 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Host: 10.222.0.45 Jul 05 16:10:11.356176 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Openstack-System-Scope: None Jul 05 16:10:11.356176 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: User-Agent: python-urllib3/1.26.9 Jul 05 16:10:11.356176 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Auth-Token: gAAAAABixGIZjiO3SMQU_kTzoiC-3Fw0DrC1MQwXBX0ACbkh2JJJ2U2XP5yzGdLhAKiBzbGCqxXn1G1RZZ5AKDYwKXE0My4Fy3qrmdBvFrqy6Q7FWKJatRQWi371tXIwqJHirdH2PKxxy_7MGJxAtroiTJ0F6Do5ynOEYKirg3hoDSsgrinK2Jc Jul 05 16:10:11.356176 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Domain-Id: None Jul 05 16:10:11.356176 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Domain-Name: None Jul 05 16:10:11.356176 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Identity-Status: Confirmed Jul 05 16:10:11.356176 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Is-Admin-Project: True Jul 05 16:10:11.356176 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Domain-Id: default Jul 05 16:10:11.356176 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Domain-Name: Default Jul 05 16:10:11.356176 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Id: ba872aaf0fd84b1eac87e18659d222d5 Jul 05 16:10:11.356176 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Name: tempest-DeleteServersTestJSON-275421852 Jul 05 16:10:11.356176 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Role: reader,member Jul 05 16:10:11.356176 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Roles: reader,member Jul 05 16:10:11.357395 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ba872aaf0fd84b1eac87e18659d222d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ba872aaf0fd84b1eac87e18659d222d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ba872aaf0fd84b1eac87e18659d222d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ba872aaf0fd84b1eac87e18659d222d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:10:11.357395 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Tenant: tempest-DeleteServersTestJSON-275421852 Jul 05 16:10:11.357395 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Tenant-Id: ba872aaf0fd84b1eac87e18659d222d5 Jul 05 16:10:11.357395 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Tenant-Name: tempest-DeleteServersTestJSON-275421852 Jul 05 16:10:11.357395 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User: tempest-DeleteServersTestJSON-275421852-project Jul 05 16:10:11.357395 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Domain-Id: default Jul 05 16:10:11.357395 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Domain-Name: Default Jul 05 16:10:11.357395 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Id: d89990bfd774417ab0eb52b91ec560d8 Jul 05 16:10:11.357395 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Name: tempest-DeleteServersTestJSON-275421852-project Jul 05 16:10:11.357395 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: method: > Jul 05 16:10:11.357395 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: exception: Instance 57bf131c-eb9d-4831-90e4-078609e6ff06 could not be found. Jul 05 16:10:11.357395 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: action_args: {'server_id': '57bf131c-eb9d-4831-90e4-078609e6ff06'} Jul 05 16:10:11.358191 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:10:11.358191 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:10:11.358191 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:10:11.358191 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:10:11.358191 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:10:11.358191 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:10:11.358191 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:10:11.358191 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:10:11.358191 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:10:11.358191 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:10:11.358191 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57bf131c-eb9d-4831-90e4-078609e6ff06 could not be found. Jul 05 16:10:11.358191 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:10:11.358191 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:10:11.358191 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:10:11.358191 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:10:11.358191 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:10:11.358191 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:10:11.358191 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:10:11.358191 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:10:11.358191 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:10:11.360031 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:10:11.360031 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 05 16:10:11.360031 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 16:10:11.360031 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 05 16:10:11.360031 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 16:10:11.360031 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 05 16:10:11.360031 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 05 16:10:11.360031 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:10:11.360031 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:10:11.360031 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57bf131c-eb9d-4831-90e4-078609e6ff06 could not be found. Jul 05 16:10:11.360031 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:10:11.360031 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:10:11.360031 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:10:11.360031 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:10:11.360031 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:10:11.360031 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:10:11.360031 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:10:11.360031 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:10:11.360031 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57bf131c-eb9d-4831-90e4-078609e6ff06 could not be found. Jul 05 16:10:11.360031 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:10:11.363471 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-d4192549-0f15-4916-a75c-f6fc8197dad6 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Returning 404 to user: Instance 57bf131c-eb9d-4831-90e4-078609e6ff06 could not be found. {{(pid=118319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:10:11.363471 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-d4192549-0f15-4916-a75c-f6fc8197dad6 tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031753 Jul 05 16:10:11.363471 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 121/235] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Jul 5 16:10:11 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 16:10:12.190324 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-e485e0ce-698b-4ed2-831a-358131be873c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:12.190967 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-e485e0ce-698b-4ed2-831a-358131be873c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:12.198502 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e485e0ce-698b-4ed2-831a-358131be873c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:12.199023 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e485e0ce-698b-4ed2-831a-358131be873c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:12.199687 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e485e0ce-698b-4ed2-831a-358131be873c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:12.200282 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e485e0ce-698b-4ed2-831a-358131be873c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:12.336669 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-e485e0ce-698b-4ed2-831a-358131be873c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:12.344473 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-e485e0ce-698b-4ed2-831a-358131be873c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1521 microversion: 2.1 time: 0.158181 Jul 05 16:10:12.345076 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 115/236] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:12 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:12.743216 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-3ec2de8c-62dd-46fd-be53-ec8ea82a237b tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:12.743666 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-3ec2de8c-62dd-46fd-be53-ec8ea82a237b tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:12.749694 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3ec2de8c-62dd-46fd-be53-ec8ea82a237b tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:12.750128 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3ec2de8c-62dd-46fd-be53-ec8ea82a237b tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:12.750887 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3ec2de8c-62dd-46fd-be53-ec8ea82a237b tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:12.751327 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3ec2de8c-62dd-46fd-be53-ec8ea82a237b tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:12.764951 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.wsgi [None req-3ec2de8c-62dd-46fd-be53-ec8ea82a237b tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] HTTP exception thrown: Instance 57bf131c-eb9d-4831-90e4-078609e6ff06 could not be found. Jul 05 16:10:12.767131 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-3ec2de8c-62dd-46fd-be53-ec8ea82a237b tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Request method failure captured: Jul 05 16:10:12.767131 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: request: DELETE /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 HTTP/1.1 Jul 05 16:10:12.767131 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Accept: application/json Jul 05 16:10:12.767131 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Accept-Encoding: identity Jul 05 16:10:12.767131 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Connection: close Jul 05 16:10:12.767131 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Content-Length: 0 Jul 05 16:10:12.767131 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Content-Type: application/json Jul 05 16:10:12.767131 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Host: 10.222.0.45 Jul 05 16:10:12.767131 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Openstack-System-Scope: None Jul 05 16:10:12.767131 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: User-Agent: python-urllib3/1.26.9 Jul 05 16:10:12.767131 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Auth-Token: gAAAAABixGIZjiO3SMQU_kTzoiC-3Fw0DrC1MQwXBX0ACbkh2JJJ2U2XP5yzGdLhAKiBzbGCqxXn1G1RZZ5AKDYwKXE0My4Fy3qrmdBvFrqy6Q7FWKJatRQWi371tXIwqJHirdH2PKxxy_7MGJxAtroiTJ0F6Do5ynOEYKirg3hoDSsgrinK2Jc Jul 05 16:10:12.767131 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Domain-Id: None Jul 05 16:10:12.767131 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Domain-Name: None Jul 05 16:10:12.767131 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Identity-Status: Confirmed Jul 05 16:10:12.767131 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Is-Admin-Project: True Jul 05 16:10:12.767131 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Domain-Id: default Jul 05 16:10:12.767131 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Domain-Name: Default Jul 05 16:10:12.767131 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Id: ba872aaf0fd84b1eac87e18659d222d5 Jul 05 16:10:12.767131 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Name: tempest-DeleteServersTestJSON-275421852 Jul 05 16:10:12.767131 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Role: reader,member Jul 05 16:10:12.767131 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Roles: reader,member Jul 05 16:10:12.768923 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ba872aaf0fd84b1eac87e18659d222d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ba872aaf0fd84b1eac87e18659d222d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ba872aaf0fd84b1eac87e18659d222d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ba872aaf0fd84b1eac87e18659d222d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:10:12.768923 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Tenant: tempest-DeleteServersTestJSON-275421852 Jul 05 16:10:12.768923 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Tenant-Id: ba872aaf0fd84b1eac87e18659d222d5 Jul 05 16:10:12.768923 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Tenant-Name: tempest-DeleteServersTestJSON-275421852 Jul 05 16:10:12.768923 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User: tempest-DeleteServersTestJSON-275421852-project Jul 05 16:10:12.768923 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Domain-Id: default Jul 05 16:10:12.768923 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Domain-Name: Default Jul 05 16:10:12.768923 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Id: d89990bfd774417ab0eb52b91ec560d8 Jul 05 16:10:12.768923 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Name: tempest-DeleteServersTestJSON-275421852-project Jul 05 16:10:12.768923 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: method: > Jul 05 16:10:12.768923 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: exception: Instance 57bf131c-eb9d-4831-90e4-078609e6ff06 could not be found. Jul 05 16:10:12.768923 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: action_args: {'id': '57bf131c-eb9d-4831-90e4-078609e6ff06'} Jul 05 16:10:12.769668 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:10:12.769668 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:10:12.769668 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:10:12.769668 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:10:12.769668 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:10:12.769668 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:10:12.769668 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:10:12.769668 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:10:12.769668 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:10:12.769668 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:10:12.769668 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57bf131c-eb9d-4831-90e4-078609e6ff06 could not be found. Jul 05 16:10:12.769668 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:10:12.769668 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:10:12.769668 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:10:12.769668 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:10:12.769668 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:10:12.769668 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:10:12.769668 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:10:12.769668 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:10:12.769668 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:10:12.771165 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:10:12.771165 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 16:10:12.771165 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 16:10:12.771165 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 16:10:12.771165 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 16:10:12.771165 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:10:12.771165 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:10:12.771165 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:10:12.771165 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:10:12.771165 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57bf131c-eb9d-4831-90e4-078609e6ff06 could not be found. Jul 05 16:10:12.771165 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:10:12.771165 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:10:12.771165 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:10:12.771165 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:10:12.771165 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:10:12.771165 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:10:12.771165 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:10:12.771165 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:10:12.771165 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57bf131c-eb9d-4831-90e4-078609e6ff06 could not be found. Jul 05 16:10:12.771165 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:10:12.778062 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-3ec2de8c-62dd-46fd-be53-ec8ea82a237b tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Returning 404 to user: Instance 57bf131c-eb9d-4831-90e4-078609e6ff06 could not be found. {{(pid=118319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:10:12.778062 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-3ec2de8c-62dd-46fd-be53-ec8ea82a237b tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "DELETE /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 404 len: 111 microversion: 2.1 time: 0.030053 Jul 05 16:10:12.778062 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 122/237] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Jul 5 16:10:12 2022] DELETE /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 16:10:12.778330 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-8f2c4a1e-d50a-4faf-96a5-f656ec6b2efb tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:12.778514 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-8f2c4a1e-d50a-4faf-96a5-f656ec6b2efb tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] [instance: 57bf131c-eb9d-4831-90e4-078609e6ff06] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:12.784511 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8f2c4a1e-d50a-4faf-96a5-f656ec6b2efb tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:12.785019 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8f2c4a1e-d50a-4faf-96a5-f656ec6b2efb tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:12.785786 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8f2c4a1e-d50a-4faf-96a5-f656ec6b2efb tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:12.786225 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8f2c4a1e-d50a-4faf-96a5-f656ec6b2efb tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:12.800562 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-8f2c4a1e-d50a-4faf-96a5-f656ec6b2efb tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] HTTP exception thrown: Instance 57bf131c-eb9d-4831-90e4-078609e6ff06 could not be found. Jul 05 16:10:12.801459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-8f2c4a1e-d50a-4faf-96a5-f656ec6b2efb tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Request method failure captured: Jul 05 16:10:12.801459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 HTTP/1.1 Jul 05 16:10:12.801459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:10:12.801459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:10:12.801459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:10:12.801459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:10:12.801459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:10:12.801459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:10:12.801459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:10:12.801459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:10:12.801459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIZjiO3SMQU_kTzoiC-3Fw0DrC1MQwXBX0ACbkh2JJJ2U2XP5yzGdLhAKiBzbGCqxXn1G1RZZ5AKDYwKXE0My4Fy3qrmdBvFrqy6Q7FWKJatRQWi371tXIwqJHirdH2PKxxy_7MGJxAtroiTJ0F6Do5ynOEYKirg3hoDSsgrinK2Jc Jul 05 16:10:12.801459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:10:12.801459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:10:12.801459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:10:12.801459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:10:12.801459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:10:12.801459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:10:12.801459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: ba872aaf0fd84b1eac87e18659d222d5 Jul 05 16:10:12.801459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-DeleteServersTestJSON-275421852 Jul 05 16:10:12.801459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:10:12.801459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:10:12.802881 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ba872aaf0fd84b1eac87e18659d222d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ba872aaf0fd84b1eac87e18659d222d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ba872aaf0fd84b1eac87e18659d222d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ba872aaf0fd84b1eac87e18659d222d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:10:12.802881 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-DeleteServersTestJSON-275421852 Jul 05 16:10:12.802881 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: ba872aaf0fd84b1eac87e18659d222d5 Jul 05 16:10:12.802881 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-DeleteServersTestJSON-275421852 Jul 05 16:10:12.802881 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-DeleteServersTestJSON-275421852-project Jul 05 16:10:12.802881 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:10:12.802881 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:10:12.802881 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: d89990bfd774417ab0eb52b91ec560d8 Jul 05 16:10:12.802881 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-DeleteServersTestJSON-275421852-project Jul 05 16:10:12.802881 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:10:12.802881 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance 57bf131c-eb9d-4831-90e4-078609e6ff06 could not be found. Jul 05 16:10:12.802881 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': '57bf131c-eb9d-4831-90e4-078609e6ff06'} Jul 05 16:10:12.804288 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:10:12.804288 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:10:12.804288 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:10:12.804288 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:10:12.804288 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:10:12.804288 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:10:12.804288 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:10:12.804288 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:10:12.804288 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:10:12.804288 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:10:12.804288 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57bf131c-eb9d-4831-90e4-078609e6ff06 could not be found. Jul 05 16:10:12.804288 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:10:12.804288 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:10:12.804288 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:10:12.804288 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:10:12.804288 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:10:12.804288 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:10:12.804288 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:10:12.804288 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:10:12.804288 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:10:12.805578 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:10:12.805578 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 16:10:12.805578 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 16:10:12.805578 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:10:12.805578 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:10:12.805578 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:10:12.805578 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:10:12.805578 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57bf131c-eb9d-4831-90e4-078609e6ff06 could not be found. Jul 05 16:10:12.805578 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:10:12.805578 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:10:12.805578 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:10:12.805578 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:10:12.805578 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:10:12.805578 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:10:12.805578 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:10:12.805578 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:10:12.805578 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57bf131c-eb9d-4831-90e4-078609e6ff06 could not be found. Jul 05 16:10:12.805578 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:10:12.806701 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-8f2c4a1e-d50a-4faf-96a5-f656ec6b2efb tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] Returning 404 to user: Instance 57bf131c-eb9d-4831-90e4-078609e6ff06 could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:10:12.806701 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-8f2c4a1e-d50a-4faf-96a5-f656ec6b2efb tempest-DeleteServersTestJSON-275421852 tempest-DeleteServersTestJSON-275421852-project] 10.222.0.45 "GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06" status: 404 len: 111 microversion: 2.1 time: 0.028910 Jul 05 16:10:12.806701 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 116/238] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:12 2022] GET /compute/v2.1/servers/57bf131c-eb9d-4831-90e4-078609e6ff06 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 16:10:13.361980 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-e95455c9-e78d-48a0-bb32-9e6dd4440db3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:13.362473 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-e95455c9-e78d-48a0-bb32-9e6dd4440db3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:13.369133 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e95455c9-e78d-48a0-bb32-9e6dd4440db3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:13.369820 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e95455c9-e78d-48a0-bb32-9e6dd4440db3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:13.370594 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e95455c9-e78d-48a0-bb32-9e6dd4440db3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:13.371036 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e95455c9-e78d-48a0-bb32-9e6dd4440db3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:13.515858 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-e95455c9-e78d-48a0-bb32-9e6dd4440db3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:13.523928 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-e95455c9-e78d-48a0-bb32-9e6dd4440db3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1521 microversion: 2.1 time: 0.166262 Jul 05 16:10:13.524593 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 123/239] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:13 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:14.547884 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-0ff298ea-d96a-4903-b2b3-2607e4e5c32a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:14.548282 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-0ff298ea-d96a-4903-b2b3-2607e4e5c32a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:14.558667 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0ff298ea-d96a-4903-b2b3-2607e4e5c32a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:14.558667 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0ff298ea-d96a-4903-b2b3-2607e4e5c32a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:14.559605 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0ff298ea-d96a-4903-b2b3-2607e4e5c32a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:14.560063 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0ff298ea-d96a-4903-b2b3-2607e4e5c32a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:14.797759 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-0ff298ea-d96a-4903-b2b3-2607e4e5c32a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:14.810401 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-0ff298ea-d96a-4903-b2b3-2607e4e5c32a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1521 microversion: 2.1 time: 0.273247 Jul 05 16:10:14.812820 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 117/240] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:14 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:15.827741 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-429eef72-554e-4c49-a00b-45e2f4bd3729 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:15.828367 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-429eef72-554e-4c49-a00b-45e2f4bd3729 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:15.836158 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-429eef72-554e-4c49-a00b-45e2f4bd3729 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:15.836672 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-429eef72-554e-4c49-a00b-45e2f4bd3729 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:15.837424 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-429eef72-554e-4c49-a00b-45e2f4bd3729 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:15.837859 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-429eef72-554e-4c49-a00b-45e2f4bd3729 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:16.005144 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-429eef72-554e-4c49-a00b-45e2f4bd3729 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:16.017667 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-429eef72-554e-4c49-a00b-45e2f4bd3729 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1521 microversion: 2.1 time: 0.193880 Jul 05 16:10:16.018356 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 124/241] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:15 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:17.039706 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-234a4763-6207-4a38-932a-2e597f171b64 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:17.041617 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-234a4763-6207-4a38-932a-2e597f171b64 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:17.056406 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-234a4763-6207-4a38-932a-2e597f171b64 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:17.056904 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-234a4763-6207-4a38-932a-2e597f171b64 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:17.057791 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-234a4763-6207-4a38-932a-2e597f171b64 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:17.058268 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-234a4763-6207-4a38-932a-2e597f171b64 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:17.250034 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-234a4763-6207-4a38-932a-2e597f171b64 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:17.261857 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-234a4763-6207-4a38-932a-2e597f171b64 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1521 microversion: 2.1 time: 0.230353 Jul 05 16:10:17.262774 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 118/242] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:17 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:18.280104 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-5ba30bd8-b8a9-43e4-bc11-4e8d5ec435f3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:18.281447 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-5ba30bd8-b8a9-43e4-bc11-4e8d5ec435f3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:18.292014 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-5ba30bd8-b8a9-43e4-bc11-4e8d5ec435f3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:18.292014 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-5ba30bd8-b8a9-43e4-bc11-4e8d5ec435f3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:18.292014 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-5ba30bd8-b8a9-43e4-bc11-4e8d5ec435f3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:18.292014 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-5ba30bd8-b8a9-43e4-bc11-4e8d5ec435f3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:18.447543 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-5ba30bd8-b8a9-43e4-bc11-4e8d5ec435f3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:18.454987 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-5ba30bd8-b8a9-43e4-bc11-4e8d5ec435f3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1521 microversion: 2.1 time: 0.178818 Jul 05 16:10:18.455549 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 125/243] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:18 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:19.472237 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-b2a98f4a-dcff-4642-b1ae-ec796f61c45f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:19.472896 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-b2a98f4a-dcff-4642-b1ae-ec796f61c45f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:19.486621 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b2a98f4a-dcff-4642-b1ae-ec796f61c45f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:19.486621 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b2a98f4a-dcff-4642-b1ae-ec796f61c45f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:19.486621 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b2a98f4a-dcff-4642-b1ae-ec796f61c45f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:19.486621 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b2a98f4a-dcff-4642-b1ae-ec796f61c45f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:19.615350 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-b2a98f4a-dcff-4642-b1ae-ec796f61c45f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:19.623463 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-b2a98f4a-dcff-4642-b1ae-ec796f61c45f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1521 microversion: 2.1 time: 0.155261 Jul 05 16:10:19.624210 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 119/244] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:19 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:20.647629 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-7c8b29b8-57e2-4579-aa5a-1ecef2b529de tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:20.648799 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-7c8b29b8-57e2-4579-aa5a-1ecef2b529de tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:20.667731 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7c8b29b8-57e2-4579-aa5a-1ecef2b529de tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:20.667731 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7c8b29b8-57e2-4579-aa5a-1ecef2b529de tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:20.669114 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7c8b29b8-57e2-4579-aa5a-1ecef2b529de tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:20.669771 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7c8b29b8-57e2-4579-aa5a-1ecef2b529de tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:20.840758 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-7c8b29b8-57e2-4579-aa5a-1ecef2b529de tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:20.848283 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-7c8b29b8-57e2-4579-aa5a-1ecef2b529de tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1521 microversion: 2.1 time: 0.211208 Jul 05 16:10:20.848915 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 126/245] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:20 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:21.866885 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-68051e27-2df4-4c07-a3d0-735453dcd14b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:21.867478 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-68051e27-2df4-4c07-a3d0-735453dcd14b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:21.873897 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-68051e27-2df4-4c07-a3d0-735453dcd14b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:21.874330 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-68051e27-2df4-4c07-a3d0-735453dcd14b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:21.875091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-68051e27-2df4-4c07-a3d0-735453dcd14b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:21.875527 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-68051e27-2df4-4c07-a3d0-735453dcd14b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:22.003963 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-68051e27-2df4-4c07-a3d0-735453dcd14b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:22.012408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-68051e27-2df4-4c07-a3d0-735453dcd14b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1521 microversion: 2.1 time: 0.150035 Jul 05 16:10:22.013005 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 120/246] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:21 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:23.029320 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-963da58b-e950-4b06-97a7-28287f92268a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:23.029929 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-963da58b-e950-4b06-97a7-28287f92268a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:23.035834 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-963da58b-e950-4b06-97a7-28287f92268a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:23.036348 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-963da58b-e950-4b06-97a7-28287f92268a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:23.037190 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-963da58b-e950-4b06-97a7-28287f92268a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:23.037627 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-963da58b-e950-4b06-97a7-28287f92268a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:23.175854 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-963da58b-e950-4b06-97a7-28287f92268a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:23.185439 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-963da58b-e950-4b06-97a7-28287f92268a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1501 microversion: 2.1 time: 0.159878 Jul 05 16:10:23.186043 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 127/247] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:23 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1501 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:23.202117 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-6e62e434-f3f5-488b-ab6d-8e22ae9dde9d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:23.202727 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-6e62e434-f3f5-488b-ab6d-8e22ae9dde9d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:23.209226 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6e62e434-f3f5-488b-ab6d-8e22ae9dde9d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:23.209666 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6e62e434-f3f5-488b-ab6d-8e22ae9dde9d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:23.210429 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6e62e434-f3f5-488b-ab6d-8e22ae9dde9d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:23.210857 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6e62e434-f3f5-488b-ab6d-8e22ae9dde9d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:23.362076 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-6e62e434-f3f5-488b-ab6d-8e22ae9dde9d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:23.370195 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-6e62e434-f3f5-488b-ab6d-8e22ae9dde9d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1515 microversion: 2.1 time: 0.171879 Jul 05 16:10:23.370768 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 121/248] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:23 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:25.199964 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-8a9eecf6-697f-4ee9-9c5b-5828d2891167 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:10:25.200931 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-8a9eecf6-697f-4ee9-9c5b-5828d2891167 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:25.206821 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8a9eecf6-697f-4ee9-9c5b-5828d2891167 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:25.207264 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8a9eecf6-697f-4ee9-9c5b-5828d2891167 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:25.208020 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8a9eecf6-697f-4ee9-9c5b-5828d2891167 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:25.208481 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8a9eecf6-697f-4ee9-9c5b-5828d2891167 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:25.231381 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:10:25.238204 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.objects.instance [None req-8a9eecf6-697f-4ee9-9c5b-5828d2891167 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lazy-loading 'flavor' on Instance uuid 4233316e-f948-4729-a298-95bfa8d528da {{(pid=118319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 16:10:25.561947 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-8a9eecf6-697f-4ee9-9c5b-5828d2891167 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "POST /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da/action" status: 200 len: 32 microversion: 2.1 time: 0.365472 Jul 05 16:10:25.562598 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 128/249] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Jul 5 16:10:25 2022] POST /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da/action => generated 32 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 16:10:25.580347 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-34141226-33ea-4103-bdc4-fafb784c8cc4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:25.581001 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-34141226-33ea-4103-bdc4-fafb784c8cc4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:25.587557 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-34141226-33ea-4103-bdc4-fafb784c8cc4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:25.588012 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-34141226-33ea-4103-bdc4-fafb784c8cc4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:25.588799 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-34141226-33ea-4103-bdc4-fafb784c8cc4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:25.589242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-34141226-33ea-4103-bdc4-fafb784c8cc4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:25.721628 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-34141226-33ea-4103-bdc4-fafb784c8cc4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:25.729677 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-34141226-33ea-4103-bdc4-fafb784c8cc4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1521 microversion: 2.1 time: 0.153190 Jul 05 16:10:25.730346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 122/250] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:25 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:26.750208 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-a1d37eb4-5dc0-410f-8aaa-89662cc94fad tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:26.750844 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-a1d37eb4-5dc0-410f-8aaa-89662cc94fad tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:26.757816 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a1d37eb4-5dc0-410f-8aaa-89662cc94fad tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:26.758259 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a1d37eb4-5dc0-410f-8aaa-89662cc94fad tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:26.759041 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a1d37eb4-5dc0-410f-8aaa-89662cc94fad tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:26.759474 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a1d37eb4-5dc0-410f-8aaa-89662cc94fad tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:26.896307 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-a1d37eb4-5dc0-410f-8aaa-89662cc94fad tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:26.904389 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-a1d37eb4-5dc0-410f-8aaa-89662cc94fad tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1521 microversion: 2.1 time: 0.158711 Jul 05 16:10:26.915517 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 129/251] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:26 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:27.921683 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-c31ea2f9-173b-46ca-aa7a-7ee623b89706 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:27.922522 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-c31ea2f9-173b-46ca-aa7a-7ee623b89706 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:27.929069 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c31ea2f9-173b-46ca-aa7a-7ee623b89706 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:27.929517 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c31ea2f9-173b-46ca-aa7a-7ee623b89706 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:27.930314 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c31ea2f9-173b-46ca-aa7a-7ee623b89706 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:27.930746 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c31ea2f9-173b-46ca-aa7a-7ee623b89706 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:28.142939 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c31ea2f9-173b-46ca-aa7a-7ee623b89706 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:28.151117 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-c31ea2f9-173b-46ca-aa7a-7ee623b89706 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1521 microversion: 2.1 time: 0.233268 Jul 05 16:10:28.152104 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 123/252] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:27 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:29.174871 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-cd8f7d05-68c2-4a9d-ac37-9a689059082e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:29.175492 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-cd8f7d05-68c2-4a9d-ac37-9a689059082e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:29.183219 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cd8f7d05-68c2-4a9d-ac37-9a689059082e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:29.183663 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cd8f7d05-68c2-4a9d-ac37-9a689059082e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:29.184426 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cd8f7d05-68c2-4a9d-ac37-9a689059082e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:29.184879 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cd8f7d05-68c2-4a9d-ac37-9a689059082e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:29.338424 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-cd8f7d05-68c2-4a9d-ac37-9a689059082e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:29.347203 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-cd8f7d05-68c2-4a9d-ac37-9a689059082e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1521 microversion: 2.1 time: 0.176773 Jul 05 16:10:29.347784 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 130/253] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:29 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:30.365215 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-c620f6bf-4ac8-44a3-b3e6-e42caf60eca0 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:30.365944 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-c620f6bf-4ac8-44a3-b3e6-e42caf60eca0 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:30.372402 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c620f6bf-4ac8-44a3-b3e6-e42caf60eca0 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:30.372932 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c620f6bf-4ac8-44a3-b3e6-e42caf60eca0 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:30.373880 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c620f6bf-4ac8-44a3-b3e6-e42caf60eca0 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:30.374314 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c620f6bf-4ac8-44a3-b3e6-e42caf60eca0 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:30.501890 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c620f6bf-4ac8-44a3-b3e6-e42caf60eca0 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:30.509943 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-c620f6bf-4ac8-44a3-b3e6-e42caf60eca0 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1521 microversion: 2.1 time: 0.148620 Jul 05 16:10:30.510543 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 124/254] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:30 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:31.528326 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-bc50a7ec-a474-44ee-95ef-ae6bf612caa1 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:31.533223 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-bc50a7ec-a474-44ee-95ef-ae6bf612caa1 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:31.536696 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-bc50a7ec-a474-44ee-95ef-ae6bf612caa1 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:31.537276 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-bc50a7ec-a474-44ee-95ef-ae6bf612caa1 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:31.538304 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-bc50a7ec-a474-44ee-95ef-ae6bf612caa1 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:31.539008 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-bc50a7ec-a474-44ee-95ef-ae6bf612caa1 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:31.677048 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-bc50a7ec-a474-44ee-95ef-ae6bf612caa1 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:31.683684 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-bc50a7ec-a474-44ee-95ef-ae6bf612caa1 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1521 microversion: 2.1 time: 0.159999 Jul 05 16:10:31.684248 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 131/255] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:31 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:32.700417 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-3a8e4916-fe5a-45e8-a993-e131b93329c8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:32.701190 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-3a8e4916-fe5a-45e8-a993-e131b93329c8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:32.707562 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3a8e4916-fe5a-45e8-a993-e131b93329c8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:32.708030 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3a8e4916-fe5a-45e8-a993-e131b93329c8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:32.708844 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3a8e4916-fe5a-45e8-a993-e131b93329c8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:32.709285 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3a8e4916-fe5a-45e8-a993-e131b93329c8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:32.845318 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-3a8e4916-fe5a-45e8-a993-e131b93329c8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:32.854564 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-3a8e4916-fe5a-45e8-a993-e131b93329c8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1521 microversion: 2.1 time: 0.157943 Jul 05 16:10:32.855146 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 125/256] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:32 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:33.871833 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-ca7e20df-ac20-44c2-bb33-15e7096c0f94 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:33.872461 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-ca7e20df-ac20-44c2-bb33-15e7096c0f94 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:33.878543 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ca7e20df-ac20-44c2-bb33-15e7096c0f94 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:33.879000 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ca7e20df-ac20-44c2-bb33-15e7096c0f94 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:33.879768 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ca7e20df-ac20-44c2-bb33-15e7096c0f94 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:33.880209 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ca7e20df-ac20-44c2-bb33-15e7096c0f94 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:34.015513 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-ca7e20df-ac20-44c2-bb33-15e7096c0f94 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:34.023068 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-ca7e20df-ac20-44c2-bb33-15e7096c0f94 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1521 microversion: 2.1 time: 0.155154 Jul 05 16:10:34.024269 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 132/257] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:33 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:35.042757 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-87fb5bc8-e553-42d1-b367-0b19cf21c0ae tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:35.042757 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-87fb5bc8-e553-42d1-b367-0b19cf21c0ae tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:35.051551 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-87fb5bc8-e553-42d1-b367-0b19cf21c0ae tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:35.052009 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-87fb5bc8-e553-42d1-b367-0b19cf21c0ae tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:35.053005 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-87fb5bc8-e553-42d1-b367-0b19cf21c0ae tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:35.053450 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-87fb5bc8-e553-42d1-b367-0b19cf21c0ae tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:35.195637 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-87fb5bc8-e553-42d1-b367-0b19cf21c0ae tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:35.203404 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-87fb5bc8-e553-42d1-b367-0b19cf21c0ae tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1521 microversion: 2.1 time: 0.166151 Jul 05 16:10:35.204062 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 126/258] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:35 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:36.220300 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-45a77df4-9d75-4298-93ac-10278a86ace0 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:36.220949 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-45a77df4-9d75-4298-93ac-10278a86ace0 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:36.228546 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-45a77df4-9d75-4298-93ac-10278a86ace0 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:36.229159 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-45a77df4-9d75-4298-93ac-10278a86ace0 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:36.230297 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-45a77df4-9d75-4298-93ac-10278a86ace0 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:36.230920 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-45a77df4-9d75-4298-93ac-10278a86ace0 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:36.373882 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-45a77df4-9d75-4298-93ac-10278a86ace0 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:36.379047 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-45a77df4-9d75-4298-93ac-10278a86ace0 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1521 microversion: 2.1 time: 0.162366 Jul 05 16:10:36.379781 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 133/259] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:36 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:37.399332 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-a51b0673-6240-40da-815a-df54d424bbdf tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:37.399947 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-a51b0673-6240-40da-815a-df54d424bbdf tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:37.406446 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a51b0673-6240-40da-815a-df54d424bbdf tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:37.406898 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a51b0673-6240-40da-815a-df54d424bbdf tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:37.407788 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a51b0673-6240-40da-815a-df54d424bbdf tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:37.408229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a51b0673-6240-40da-815a-df54d424bbdf tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:37.536573 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-a51b0673-6240-40da-815a-df54d424bbdf tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:37.544826 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-a51b0673-6240-40da-815a-df54d424bbdf tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1521 microversion: 2.1 time: 0.149329 Jul 05 16:10:37.545344 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 127/260] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:37 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:38.561892 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-5eff1256-1b23-4fb2-8d38-c85a53714457 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:38.562516 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-5eff1256-1b23-4fb2-8d38-c85a53714457 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:38.568663 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-5eff1256-1b23-4fb2-8d38-c85a53714457 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:38.569141 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-5eff1256-1b23-4fb2-8d38-c85a53714457 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:38.569903 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-5eff1256-1b23-4fb2-8d38-c85a53714457 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:38.574935 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-5eff1256-1b23-4fb2-8d38-c85a53714457 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:38.706277 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-5eff1256-1b23-4fb2-8d38-c85a53714457 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:38.714272 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-5eff1256-1b23-4fb2-8d38-c85a53714457 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1521 microversion: 2.1 time: 0.156256 Jul 05 16:10:38.714778 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 134/261] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:38 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:39.731712 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-c577fa0d-dc09-4e44-87ab-ad5dc8620a1d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:39.732357 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-c577fa0d-dc09-4e44-87ab-ad5dc8620a1d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:39.739048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c577fa0d-dc09-4e44-87ab-ad5dc8620a1d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:39.739502 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c577fa0d-dc09-4e44-87ab-ad5dc8620a1d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:39.740262 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c577fa0d-dc09-4e44-87ab-ad5dc8620a1d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:39.740701 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c577fa0d-dc09-4e44-87ab-ad5dc8620a1d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:39.743849 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=93 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:10:39.878686 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c577fa0d-dc09-4e44-87ab-ad5dc8620a1d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:39.886130 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-c577fa0d-dc09-4e44-87ab-ad5dc8620a1d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1521 microversion: 2.1 time: 0.158823 Jul 05 16:10:39.886700 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 128/262] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:39 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:40.903454 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-f58c1e19-41a3-406c-9c44-a2be09ad6514 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:40.904099 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-f58c1e19-41a3-406c-9c44-a2be09ad6514 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:40.910398 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f58c1e19-41a3-406c-9c44-a2be09ad6514 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:40.910848 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f58c1e19-41a3-406c-9c44-a2be09ad6514 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:40.911610 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f58c1e19-41a3-406c-9c44-a2be09ad6514 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:40.912048 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f58c1e19-41a3-406c-9c44-a2be09ad6514 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:41.050833 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-f58c1e19-41a3-406c-9c44-a2be09ad6514 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:41.058728 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-f58c1e19-41a3-406c-9c44-a2be09ad6514 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1521 microversion: 2.1 time: 0.159352 Jul 05 16:10:41.059297 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 135/263] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:40 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:42.076230 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-019c3d3b-f45f-4ef7-8d96-1d8ace46ce18 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:42.076863 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-019c3d3b-f45f-4ef7-8d96-1d8ace46ce18 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:42.083824 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-019c3d3b-f45f-4ef7-8d96-1d8ace46ce18 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:42.084332 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-019c3d3b-f45f-4ef7-8d96-1d8ace46ce18 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:42.085181 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-019c3d3b-f45f-4ef7-8d96-1d8ace46ce18 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:42.085557 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-019c3d3b-f45f-4ef7-8d96-1d8ace46ce18 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:42.215867 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-019c3d3b-f45f-4ef7-8d96-1d8ace46ce18 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:42.223258 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-019c3d3b-f45f-4ef7-8d96-1d8ace46ce18 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1521 microversion: 2.1 time: 0.151183 Jul 05 16:10:42.223828 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 129/264] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:42 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:43.239571 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-36dffc27-4100-40bf-ba4a-93727c6b3243 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:43.240187 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-36dffc27-4100-40bf-ba4a-93727c6b3243 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:43.242217 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_api:SELECT=32 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:10:43.247023 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-36dffc27-4100-40bf-ba4a-93727c6b3243 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:43.247472 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-36dffc27-4100-40bf-ba4a-93727c6b3243 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:43.248236 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-36dffc27-4100-40bf-ba4a-93727c6b3243 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:43.248676 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-36dffc27-4100-40bf-ba4a-93727c6b3243 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:43.386544 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-36dffc27-4100-40bf-ba4a-93727c6b3243 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:43.394012 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-36dffc27-4100-40bf-ba4a-93727c6b3243 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1521 microversion: 2.1 time: 0.158370 Jul 05 16:10:43.394578 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 136/265] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:43 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:44.411584 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-a3560c47-17c2-4af6-bf5d-2fd964d791b3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:44.412849 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-a3560c47-17c2-4af6-bf5d-2fd964d791b3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:44.419724 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_api:SELECT=32 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:10:44.421427 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a3560c47-17c2-4af6-bf5d-2fd964d791b3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:44.422114 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a3560c47-17c2-4af6-bf5d-2fd964d791b3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:44.422896 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a3560c47-17c2-4af6-bf5d-2fd964d791b3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:44.423334 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a3560c47-17c2-4af6-bf5d-2fd964d791b3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:44.564867 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-a3560c47-17c2-4af6-bf5d-2fd964d791b3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:44.572647 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-a3560c47-17c2-4af6-bf5d-2fd964d791b3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1521 microversion: 2.1 time: 0.164885 Jul 05 16:10:44.573418 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 130/266] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:44 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:45.592705 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-eb42de1f-6f90-4221-b3a8-a45a280eb4f5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:45.597031 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-eb42de1f-6f90-4221-b3a8-a45a280eb4f5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:45.604493 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-eb42de1f-6f90-4221-b3a8-a45a280eb4f5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:45.605314 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-eb42de1f-6f90-4221-b3a8-a45a280eb4f5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:45.606455 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-eb42de1f-6f90-4221-b3a8-a45a280eb4f5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:45.607058 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-eb42de1f-6f90-4221-b3a8-a45a280eb4f5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:45.787672 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-eb42de1f-6f90-4221-b3a8-a45a280eb4f5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:45.795690 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-eb42de1f-6f90-4221-b3a8-a45a280eb4f5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1521 microversion: 2.1 time: 0.209095 Jul 05 16:10:45.796600 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 137/267] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:45 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:46.813065 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-a79e2508-68f0-4c6a-9d20-87b24f4e4342 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:46.813679 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-a79e2508-68f0-4c6a-9d20-87b24f4e4342 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:46.819696 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a79e2508-68f0-4c6a-9d20-87b24f4e4342 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:46.820153 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a79e2508-68f0-4c6a-9d20-87b24f4e4342 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:46.820976 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a79e2508-68f0-4c6a-9d20-87b24f4e4342 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:46.821418 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a79e2508-68f0-4c6a-9d20-87b24f4e4342 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:46.954390 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-a79e2508-68f0-4c6a-9d20-87b24f4e4342 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:46.962211 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-a79e2508-68f0-4c6a-9d20-87b24f4e4342 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1521 microversion: 2.1 time: 0.153490 Jul 05 16:10:46.963443 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 131/268] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:46 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:47.980075 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-26a5755d-c4be-43f9-b60f-78bbefa22692 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:47.980596 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-26a5755d-c4be-43f9-b60f-78bbefa22692 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:47.986815 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-26a5755d-c4be-43f9-b60f-78bbefa22692 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:47.987263 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-26a5755d-c4be-43f9-b60f-78bbefa22692 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:47.988026 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-26a5755d-c4be-43f9-b60f-78bbefa22692 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:47.988461 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-26a5755d-c4be-43f9-b60f-78bbefa22692 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:48.117179 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-26a5755d-c4be-43f9-b60f-78bbefa22692 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:48.125395 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-26a5755d-c4be-43f9-b60f-78bbefa22692 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1521 microversion: 2.1 time: 0.149748 Jul 05 16:10:48.126131 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 138/269] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:47 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:49.142532 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-501c6b35-eef0-47b6-97fc-1ab3172a7fd9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:49.143066 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-501c6b35-eef0-47b6-97fc-1ab3172a7fd9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:49.150175 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-501c6b35-eef0-47b6-97fc-1ab3172a7fd9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:49.150679 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-501c6b35-eef0-47b6-97fc-1ab3172a7fd9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:49.151450 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-501c6b35-eef0-47b6-97fc-1ab3172a7fd9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:49.151892 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-501c6b35-eef0-47b6-97fc-1ab3172a7fd9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:49.278198 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-501c6b35-eef0-47b6-97fc-1ab3172a7fd9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:49.285985 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-501c6b35-eef0-47b6-97fc-1ab3172a7fd9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1521 microversion: 2.1 time: 0.147380 Jul 05 16:10:49.286549 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 132/270] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:49 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:49.502710 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-554565d9-1b6c-4ac6-86e5-48a6d52296d2 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:49.503212 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-554565d9-1b6c-4ac6-86e5-48a6d52296d2 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:49.510261 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-554565d9-1b6c-4ac6-86e5-48a6d52296d2 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:49.510700 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-554565d9-1b6c-4ac6-86e5-48a6d52296d2 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:49.511895 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-554565d9-1b6c-4ac6-86e5-48a6d52296d2 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:49.513189 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-554565d9-1b6c-4ac6-86e5-48a6d52296d2 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:49.536220 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-554565d9-1b6c-4ac6-86e5-48a6d52296d2 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a/ips" status: 200 len: 149 microversion: 2.1 time: 0.037294 Jul 05 16:10:49.536798 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 139/271] 10.222.0.45 () {58 vars in 1247 bytes} [Tue Jul 5 16:10:49 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:10:50.303174 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-ded592d3-e61d-4fde-a614-716d709b5218 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:50.304018 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-ded592d3-e61d-4fde-a614-716d709b5218 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:50.311000 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ded592d3-e61d-4fde-a614-716d709b5218 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:50.311453 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ded592d3-e61d-4fde-a614-716d709b5218 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:50.312220 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ded592d3-e61d-4fde-a614-716d709b5218 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:50.312658 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ded592d3-e61d-4fde-a614-716d709b5218 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:50.445531 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-ded592d3-e61d-4fde-a614-716d709b5218 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:50.452934 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-ded592d3-e61d-4fde-a614-716d709b5218 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1501 microversion: 2.1 time: 0.153814 Jul 05 16:10:50.453502 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 133/272] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:50 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1501 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:50.469199 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-0c62e8a5-e73e-4ba6-8d9a-628c10d473a9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be5fde44-e6d5-42e5-85d9-092cac74b661"}} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:10:50.470325 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-0c62e8a5-e73e-4ba6-8d9a-628c10d473a9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:50.476474 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0c62e8a5-e73e-4ba6-8d9a-628c10d473a9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:50.478852 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0c62e8a5-e73e-4ba6-8d9a-628c10d473a9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:50.478852 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0c62e8a5-e73e-4ba6-8d9a-628c10d473a9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:50.479057 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0c62e8a5-e73e-4ba6-8d9a-628c10d473a9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:50.503334 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.wsgi [None req-0c62e8a5-e73e-4ba6-8d9a-628c10d473a9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] HTTP exception thrown: Cannot 'attach_volume' instance 4233316e-f948-4729-a298-95bfa8d528da while it is in vm_state rescued Jul 05 16:10:50.505358 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-0c62e8a5-e73e-4ba6-8d9a-628c10d473a9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Request method failure captured: Jul 05 16:10:50.505358 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: request: POST /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da/os-volume_attachments HTTP/1.1 Jul 05 16:10:50.505358 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Accept: application/json Jul 05 16:10:50.505358 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Accept-Encoding: identity Jul 05 16:10:50.505358 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Connection: close Jul 05 16:10:50.505358 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Content-Length: 74 Jul 05 16:10:50.505358 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Content-Type: application/json Jul 05 16:10:50.505358 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Host: 10.222.0.45 Jul 05 16:10:50.505358 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Openstack-System-Scope: None Jul 05 16:10:50.505358 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: User-Agent: python-urllib3/1.26.9 Jul 05 16:10:50.505358 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Auth-Token: gAAAAABixGIbm-fGDoYcXhi-DiBd_EHf54mABU16-lVoqKUsmzMxPfvtZz3cDR_eLFLAUXUkaoXiE_x_JaCy2K0M-p1S_UwLA--ZfDF_Efr5SkiXjg8KEFbKA2u7SIH1VdWaoghMLl3WnWI8g3GmnhK30BicBR2S2x7Pflc_2x-DFM7Iz5W2JHg Jul 05 16:10:50.505358 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Domain-Id: None Jul 05 16:10:50.505358 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Domain-Name: None Jul 05 16:10:50.505358 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Identity-Status: Confirmed Jul 05 16:10:50.505358 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Is-Admin-Project: True Jul 05 16:10:50.505358 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Domain-Id: default Jul 05 16:10:50.505358 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Domain-Name: Default Jul 05 16:10:50.505358 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Id: bbe6a2de3cba4aa7b365f30f5b2f745c Jul 05 16:10:50.505358 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1117569186 Jul 05 16:10:50.505358 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Role: reader,member Jul 05 16:10:50.505358 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Roles: reader,member Jul 05 16:10:50.506648 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bbe6a2de3cba4aa7b365f30f5b2f745c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bbe6a2de3cba4aa7b365f30f5b2f745c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bbe6a2de3cba4aa7b365f30f5b2f745c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bbe6a2de3cba4aa7b365f30f5b2f745c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:10:50.506648 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1117569186 Jul 05 16:10:50.506648 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Tenant-Id: bbe6a2de3cba4aa7b365f30f5b2f745c Jul 05 16:10:50.506648 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1117569186 Jul 05 16:10:50.506648 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User: tempest-ServerRescueNegativeTestJSON-1117569186-project Jul 05 16:10:50.506648 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Domain-Id: default Jul 05 16:10:50.506648 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Domain-Name: Default Jul 05 16:10:50.506648 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Id: 8b6e665914774eabba120e986e6bb282 Jul 05 16:10:50.506648 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1117569186-project Jul 05 16:10:50.506648 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Jul 05 16:10:50.506648 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: {"volumeAttachment": {"volumeId": "be5fde44-e6d5-42e5-85d9-092cac74b661"}} Jul 05 16:10:50.506648 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: method: > Jul 05 16:10:50.507415 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: exception: Cannot 'attach_volume' instance 4233316e-f948-4729-a298-95bfa8d528da while it is in vm_state rescued Jul 05 16:10:50.507415 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: action_args: {'server_id': '4233316e-f948-4729-a298-95bfa8d528da', 'body': {'volumeAttachment': {'volumeId': 'be5fde44-e6d5-42e5-85d9-092cac74b661'}}} Jul 05 16:10:50.507415 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:10:50.507415 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:10:50.507415 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 05 16:10:50.507415 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 05 16:10:50.507415 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 05 16:10:50.507415 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 05 16:10:50.507415 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 05 16:10:50.507415 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 05 16:10:50.507415 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4233316e-f948-4729-a298-95bfa8d528da in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 05 16:10:50.507415 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:10:50.507415 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:10:50.507415 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:10:50.507415 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:10:50.507415 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:10:50.507415 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:10:50.507415 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:10:50.507415 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:10:50.508625 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:10:50.508625 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:10:50.508625 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 16:10:50.508625 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 16:10:50.508625 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 16:10:50.508625 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 16:10:50.508625 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 16:10:50.508625 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 16:10:50.508625 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 05 16:10:50.508625 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 05 16:10:50.508625 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 05 16:10:50.508625 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 05 16:10:50.508625 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4233316e-f948-4729-a298-95bfa8d528da while it is in vm_state rescued Jul 05 16:10:50.508625 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:10:50.508625 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:10:50.508625 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:10:50.508625 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:10:50.508625 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:10:50.508625 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:10:50.518201 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:10:50.518201 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:10:50.518201 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4233316e-f948-4729-a298-95bfa8d528da while it is in vm_state rescued Jul 05 16:10:50.518201 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:10:50.518201 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-0c62e8a5-e73e-4ba6-8d9a-628c10d473a9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Returning 409 to user: Cannot 'attach_volume' instance 4233316e-f948-4729-a298-95bfa8d528da while it is in vm_state rescued {{(pid=118319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:10:50.518201 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-0c62e8a5-e73e-4ba6-8d9a-628c10d473a9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "POST /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041883 Jul 05 16:10:50.518201 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 140/273] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Jul 5 16:10:50 2022] POST /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 05 16:10:50.519186 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-f2dd04a0-7bae-4a40-b9de-ca492ee1262e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:10:50.519731 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-f2dd04a0-7bae-4a40-b9de-ca492ee1262e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:50.526287 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f2dd04a0-7bae-4a40-b9de-ca492ee1262e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:50.526736 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f2dd04a0-7bae-4a40-b9de-ca492ee1262e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:50.527500 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f2dd04a0-7bae-4a40-b9de-ca492ee1262e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:50.527934 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f2dd04a0-7bae-4a40-b9de-ca492ee1262e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:50.754400 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-f2dd04a0-7bae-4a40-b9de-ca492ee1262e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "POST /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da/action" status: 202 len: 0 microversion: 2.1 time: 0.241209 Jul 05 16:10:50.758506 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 134/274] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Jul 5 16:10:50 2022] POST /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 16:10:50.763984 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-d02272c9-c6d9-4333-98da-dbb56370b2fb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:50.764601 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-d02272c9-c6d9-4333-98da-dbb56370b2fb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:50.770951 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d02272c9-c6d9-4333-98da-dbb56370b2fb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:50.771687 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d02272c9-c6d9-4333-98da-dbb56370b2fb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:50.772512 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d02272c9-c6d9-4333-98da-dbb56370b2fb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:50.772973 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d02272c9-c6d9-4333-98da-dbb56370b2fb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:51.235499 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-d02272c9-c6d9-4333-98da-dbb56370b2fb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:51.244826 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-d02272c9-c6d9-4333-98da-dbb56370b2fb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1509 microversion: 2.1 time: 0.485041 Jul 05 16:10:51.245721 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 141/275] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:50 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1509 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:51.312129 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-f41443f0-cb87-4c55-80ab-8913ee59d842 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "781b0d96-f540-40d0-bfe6-6478ffade503"}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:10:51.312129 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-f41443f0-cb87-4c55-80ab-8913ee59d842 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:51.320065 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f41443f0-cb87-4c55-80ab-8913ee59d842 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:51.320827 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f41443f0-cb87-4c55-80ab-8913ee59d842 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:51.321819 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f41443f0-cb87-4c55-80ab-8913ee59d842 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:51.322448 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f41443f0-cb87-4c55-80ab-8913ee59d842 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:52.263192 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-e02acf62-f509-4803-8b20-e73190ecc3d5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:52.263805 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-e02acf62-f509-4803-8b20-e73190ecc3d5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:52.269833 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e02acf62-f509-4803-8b20-e73190ecc3d5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:52.270283 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e02acf62-f509-4803-8b20-e73190ecc3d5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:52.271054 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e02acf62-f509-4803-8b20-e73190ecc3d5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:52.271492 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e02acf62-f509-4803-8b20-e73190ecc3d5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:52.401787 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-e02acf62-f509-4803-8b20-e73190ecc3d5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:52.409208 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-e02acf62-f509-4803-8b20-e73190ecc3d5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1509 microversion: 2.1 time: 0.150492 Jul 05 16:10:52.409767 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 142/276] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:52 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:10:53.426255 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-1cb94a48-2940-434d-addf-dca492eb6903 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:53.426833 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-1cb94a48-2940-434d-addf-dca492eb6903 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:53.433406 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1cb94a48-2940-434d-addf-dca492eb6903 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:53.433847 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1cb94a48-2940-434d-addf-dca492eb6903 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:53.434594 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1cb94a48-2940-434d-addf-dca492eb6903 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:53.435023 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1cb94a48-2940-434d-addf-dca492eb6903 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:53.575055 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-1cb94a48-2940-434d-addf-dca492eb6903 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:53.578409 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:10:53.582664 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-1cb94a48-2940-434d-addf-dca492eb6903 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1509 microversion: 2.1 time: 0.160368 Jul 05 16:10:53.583226 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 143/277] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:53 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:10:54.600083 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-fbed7b1a-80dd-42d8-a347-0ee9f83f2f06 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:54.600829 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-fbed7b1a-80dd-42d8-a347-0ee9f83f2f06 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:54.608018 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fbed7b1a-80dd-42d8-a347-0ee9f83f2f06 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:54.608803 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fbed7b1a-80dd-42d8-a347-0ee9f83f2f06 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:54.610040 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fbed7b1a-80dd-42d8-a347-0ee9f83f2f06 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:54.610484 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fbed7b1a-80dd-42d8-a347-0ee9f83f2f06 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:54.759686 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-fbed7b1a-80dd-42d8-a347-0ee9f83f2f06 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:54.766987 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-fbed7b1a-80dd-42d8-a347-0ee9f83f2f06 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1509 microversion: 2.1 time: 0.171408 Jul 05 16:10:54.767848 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 144/278] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:54 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:10:55.094746 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-f41443f0-cb87-4c55-80ab-8913ee59d842 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "POST /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.789766 Jul 05 16:10:55.095781 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 135/279] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Jul 5 16:10:51 2022] POST /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a/os-volume_attachments => generated 194 bytes in 3792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:10:55.785097 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-fd2ecb36-489c-4251-85a7-df8f1d6885fd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:55.785718 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-fd2ecb36-489c-4251-85a7-df8f1d6885fd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:55.793020 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fd2ecb36-489c-4251-85a7-df8f1d6885fd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:55.793822 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fd2ecb36-489c-4251-85a7-df8f1d6885fd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:55.795133 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fd2ecb36-489c-4251-85a7-df8f1d6885fd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:55.795586 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fd2ecb36-489c-4251-85a7-df8f1d6885fd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:55.928502 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-fd2ecb36-489c-4251-85a7-df8f1d6885fd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:55.936462 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-fd2ecb36-489c-4251-85a7-df8f1d6885fd tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1509 microversion: 2.1 time: 0.155318 Jul 05 16:10:55.937073 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 145/280] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:55 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:56.250943 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-8e33f02c-3129-437d-9827-196939d44cb0 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:56.251537 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-8e33f02c-3129-437d-9827-196939d44cb0 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:56.258359 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8e33f02c-3129-437d-9827-196939d44cb0 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:56.258817 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8e33f02c-3129-437d-9827-196939d44cb0 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:56.259576 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8e33f02c-3129-437d-9827-196939d44cb0 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:56.260025 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8e33f02c-3129-437d-9827-196939d44cb0 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:56.282120 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-8e33f02c-3129-437d-9827-196939d44cb0 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74/ips" status: 200 len: 144 microversion: 2.1 time: 0.035831 Jul 05 16:10:56.282694 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 136/281] 10.222.0.45 () {58 vars in 1247 bytes} [Tue Jul 5 16:10:56 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74/ips => generated 144 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:10:56.953180 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-aecafb6c-7725-48bc-9823-a5d589f529aa tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:56.953794 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-aecafb6c-7725-48bc-9823-a5d589f529aa tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:56.959737 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-aecafb6c-7725-48bc-9823-a5d589f529aa tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:56.960190 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-aecafb6c-7725-48bc-9823-a5d589f529aa tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:56.960981 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-aecafb6c-7725-48bc-9823-a5d589f529aa tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:56.961423 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-aecafb6c-7725-48bc-9823-a5d589f529aa tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:57.088723 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-aecafb6c-7725-48bc-9823-a5d589f529aa tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:57.100521 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-aecafb6c-7725-48bc-9823-a5d589f529aa tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1509 microversion: 2.1 time: 0.150700 Jul 05 16:10:57.101622 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 146/282] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:56 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:58.118288 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-813dc263-5012-4346-98ae-83c8a47923e8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:58.118832 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-813dc263-5012-4346-98ae-83c8a47923e8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:58.125279 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-813dc263-5012-4346-98ae-83c8a47923e8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:58.125762 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-813dc263-5012-4346-98ae-83c8a47923e8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:58.126522 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-813dc263-5012-4346-98ae-83c8a47923e8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:58.126963 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-813dc263-5012-4346-98ae-83c8a47923e8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:58.209825 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-2df62c59-f659-44fd-a2d3-41fb0c295f9a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:58.210796 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-2df62c59-f659-44fd-a2d3-41fb0c295f9a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:58.217415 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2df62c59-f659-44fd-a2d3-41fb0c295f9a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:58.217854 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2df62c59-f659-44fd-a2d3-41fb0c295f9a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:58.218799 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2df62c59-f659-44fd-a2d3-41fb0c295f9a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:58.219225 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2df62c59-f659-44fd-a2d3-41fb0c295f9a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:58.249317 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-2df62c59-f659-44fd-a2d3-41fb0c295f9a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77/ips" status: 200 len: 151 microversion: 2.20 time: 0.045508 Jul 05 16:10:58.249898 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 147/283] 10.222.0.45 () {60 vars in 1288 bytes} [Tue Jul 5 16:10:58 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77/ips => generated 151 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 05 16:10:58.268531 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-813dc263-5012-4346-98ae-83c8a47923e8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:58.285580 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-813dc263-5012-4346-98ae-83c8a47923e8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1509 microversion: 2.1 time: 0.171116 Jul 05 16:10:58.286165 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 137/284] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:58 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:10:59.303289 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-efa23fdb-9e4b-47a9-979d-4e86103c8349 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:10:59.303901 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-efa23fdb-9e4b-47a9-979d-4e86103c8349 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:10:59.311751 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-efa23fdb-9e4b-47a9-979d-4e86103c8349 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:59.312248 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-efa23fdb-9e4b-47a9-979d-4e86103c8349 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:59.313102 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-efa23fdb-9e4b-47a9-979d-4e86103c8349 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:10:59.313537 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-efa23fdb-9e4b-47a9-979d-4e86103c8349 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:10:59.576488 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-efa23fdb-9e4b-47a9-979d-4e86103c8349 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:10:59.583937 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-efa23fdb-9e4b-47a9-979d-4e86103c8349 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1509 microversion: 2.1 time: 0.284775 Jul 05 16:10:59.584479 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 148/285] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:10:59 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1509 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:00.601384 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-94061e86-cdc0-4914-a945-bd5429c9e05b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:00.601999 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-94061e86-cdc0-4914-a945-bd5429c9e05b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:00.609027 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-94061e86-cdc0-4914-a945-bd5429c9e05b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:00.609759 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-94061e86-cdc0-4914-a945-bd5429c9e05b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:00.610499 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-94061e86-cdc0-4914-a945-bd5429c9e05b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:00.610939 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-94061e86-cdc0-4914-a945-bd5429c9e05b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:00.741924 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-94061e86-cdc0-4914-a945-bd5429c9e05b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:00.750080 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-94061e86-cdc0-4914-a945-bd5429c9e05b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1509 microversion: 2.1 time: 0.152531 Jul 05 16:11:00.750645 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 138/286] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:00 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:01.763832 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-a5b5684e-faaf-4a5c-b076-5de477c05004 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f63b89f2-d118-438e-b267-d6980be57492"}} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:11:01.764944 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-a5b5684e-faaf-4a5c-b076-5de477c05004 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:01.767208 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-32065c38-7a38-412d-aa3f-9ffe0b347fa6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:01.768026 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-32065c38-7a38-412d-aa3f-9ffe0b347fa6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:01.771982 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a5b5684e-faaf-4a5c-b076-5de477c05004 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:01.772429 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a5b5684e-faaf-4a5c-b076-5de477c05004 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:01.773226 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a5b5684e-faaf-4a5c-b076-5de477c05004 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:01.773822 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a5b5684e-faaf-4a5c-b076-5de477c05004 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:01.776666 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-32065c38-7a38-412d-aa3f-9ffe0b347fa6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:01.777353 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-32065c38-7a38-412d-aa3f-9ffe0b347fa6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:01.778137 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-32065c38-7a38-412d-aa3f-9ffe0b347fa6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:01.778574 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-32065c38-7a38-412d-aa3f-9ffe0b347fa6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:01.942142 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-32065c38-7a38-412d-aa3f-9ffe0b347fa6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:01.950900 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-32065c38-7a38-412d-aa3f-9ffe0b347fa6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1509 microversion: 2.1 time: 0.187390 Jul 05 16:11:01.951489 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 139/287] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:01 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1509 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:11:02.527069 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-e4a3f53a-230f-4815-9ec9-e68edff65c2a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:11:02.527939 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-e4a3f53a-230f-4815-9ec9-e68edff65c2a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:02.542843 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e4a3f53a-230f-4815-9ec9-e68edff65c2a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:02.543287 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e4a3f53a-230f-4815-9ec9-e68edff65c2a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:02.544065 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e4a3f53a-230f-4815-9ec9-e68edff65c2a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:02.544514 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e4a3f53a-230f-4815-9ec9-e68edff65c2a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:02.572480 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.objects.instance [None req-e4a3f53a-230f-4815-9ec9-e68edff65c2a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lazy-loading 'flavor' on Instance uuid da368d38-2642-49c3-b499-eb5a977cbd77 {{(pid=118320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 16:11:03.187179 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:11:03.268388 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-a5b5684e-faaf-4a5c-b076-5de477c05004 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "POST /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.509251 Jul 05 16:11:03.276856 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 149/288] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Jul 5 16:11:01 2022] POST /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74/os-volume_attachments => generated 194 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:11:03.286568 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-ee8ab64e-601e-4802-a644-b619c792f54d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:03.287277 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-ee8ab64e-601e-4802-a644-b619c792f54d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:03.297726 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ee8ab64e-601e-4802-a644-b619c792f54d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:03.298177 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ee8ab64e-601e-4802-a644-b619c792f54d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:03.298947 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ee8ab64e-601e-4802-a644-b619c792f54d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:03.299967 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ee8ab64e-601e-4802-a644-b619c792f54d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:03.435775 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-ee8ab64e-601e-4802-a644-b619c792f54d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:03.444242 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-ee8ab64e-601e-4802-a644-b619c792f54d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1515 microversion: 2.1 time: 0.173746 Jul 05 16:11:03.444817 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 150/289] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:03 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:03.510088 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-e4a3f53a-230f-4815-9ec9-e68edff65c2a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "POST /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77/action" status: 202 len: 0 microversion: 2.20 time: 0.986195 Jul 05 16:11:03.514208 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 140/290] 10.222.0.45 () {62 vars in 1318 bytes} [Tue Jul 5 16:11:02 2022] POST /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77/action => generated 0 bytes in 989 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 05 16:11:03.519925 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-19ce0946-ecab-42d5-b4ff-76ed09f442bd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:03.520544 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-19ce0946-ecab-42d5-b4ff-76ed09f442bd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:03.527212 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-19ce0946-ecab-42d5-b4ff-76ed09f442bd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:03.527679 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-19ce0946-ecab-42d5-b4ff-76ed09f442bd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:03.528461 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-19ce0946-ecab-42d5-b4ff-76ed09f442bd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:03.528971 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-19ce0946-ecab-42d5-b4ff-76ed09f442bd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:03.659564 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-19ce0946-ecab-42d5-b4ff-76ed09f442bd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:03.668232 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-19ce0946-ecab-42d5-b4ff-76ed09f442bd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:03.669762 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-19ce0946-ecab-42d5-b4ff-76ed09f442bd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:03.670903 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-19ce0946-ecab-42d5-b4ff-76ed09f442bd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1722 microversion: 2.20 time: 0.155689 Jul 05 16:11:03.680288 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 151/291] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:03 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:11:04.690833 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-7ddc8292-9bca-44cf-a93d-af0536180fc0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:04.691542 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-7ddc8292-9bca-44cf-a93d-af0536180fc0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:04.699421 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7ddc8292-9bca-44cf-a93d-af0536180fc0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:04.699874 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7ddc8292-9bca-44cf-a93d-af0536180fc0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:04.700643 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7ddc8292-9bca-44cf-a93d-af0536180fc0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:04.701118 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7ddc8292-9bca-44cf-a93d-af0536180fc0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:04.834371 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-7ddc8292-9bca-44cf-a93d-af0536180fc0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:04.842381 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-7ddc8292-9bca-44cf-a93d-af0536180fc0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:04.844087 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-7ddc8292-9bca-44cf-a93d-af0536180fc0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:04.845410 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-7ddc8292-9bca-44cf-a93d-af0536180fc0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1722 microversion: 2.20 time: 0.159235 Jul 05 16:11:04.845969 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 141/292] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:04 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:11:05.863874 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-b745f40a-866d-47ad-81ed-639f20973f72 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:05.864575 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-b745f40a-866d-47ad-81ed-639f20973f72 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:05.871041 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b745f40a-866d-47ad-81ed-639f20973f72 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:05.876860 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b745f40a-866d-47ad-81ed-639f20973f72 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:05.876860 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b745f40a-866d-47ad-81ed-639f20973f72 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:05.876860 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b745f40a-866d-47ad-81ed-639f20973f72 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:06.005529 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-b745f40a-866d-47ad-81ed-639f20973f72 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:06.017171 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-b745f40a-866d-47ad-81ed-639f20973f72 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:06.018721 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-b745f40a-866d-47ad-81ed-639f20973f72 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:06.019882 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-b745f40a-866d-47ad-81ed-639f20973f72 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1722 microversion: 2.20 time: 0.159832 Jul 05 16:11:06.020435 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 152/293] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:05 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:11:07.040256 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-963327ae-72b3-46af-abe2-6191b482f4f2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:07.041310 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-963327ae-72b3-46af-abe2-6191b482f4f2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:07.048028 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-963327ae-72b3-46af-abe2-6191b482f4f2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:07.048482 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-963327ae-72b3-46af-abe2-6191b482f4f2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:07.049646 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-963327ae-72b3-46af-abe2-6191b482f4f2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:07.056015 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-963327ae-72b3-46af-abe2-6191b482f4f2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:07.195605 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-963327ae-72b3-46af-abe2-6191b482f4f2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:07.203875 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-963327ae-72b3-46af-abe2-6191b482f4f2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:07.205500 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-963327ae-72b3-46af-abe2-6191b482f4f2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:07.206671 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-963327ae-72b3-46af-abe2-6191b482f4f2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1722 microversion: 2.20 time: 0.171572 Jul 05 16:11:07.207223 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 142/294] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:07 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:11:07.436739 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-b1dd82a2-7e36-4fd9-b749-b25324f24f8b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Action: 'create', calling method: .version_select at 0x7f30940449d0>, body: {"keypair": {"name": "tempest-keypair-407624647", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0KCS2ahC5VEGsszOEtHzjePN0CnrIH5s8znA25ZUF7dc67yDlMRJ5njTQ7PUR2PwT6IymJuHny/KEyc6dYe3HPzqf8oOSDsR5k1qEh3dmRXOwiK6Qg01IACOPUVt7AYQ=="}} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:11:07.451685 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.quota [None req-b1dd82a2-7e36-4fd9-b749-b25324f24f8b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Getting quotas for project bbe6a2de3cba4aa7b365f30f5b2f745c. Resources: {'key_pairs'} {{(pid=118319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:11:07.472952 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.quota [None req-b1dd82a2-7e36-4fd9-b749-b25324f24f8b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Getting quotas for user 8b6e665914774eabba120e986e6bb282 and project bbe6a2de3cba4aa7b365f30f5b2f745c. Resources: {'key_pairs'} {{(pid=118319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:11:07.618109 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-b1dd82a2-7e36-4fd9-b749-b25324f24f8b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.184038 Jul 05 16:11:07.619391 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 153/295] 10.222.0.45 () {60 vars in 1158 bytes} [Tue Jul 5 16:11:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:11:08.224354 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-21e83b9f-046c-48e8-adcf-befddd51d99d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:08.225857 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-21e83b9f-046c-48e8-adcf-befddd51d99d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:08.240277 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-21e83b9f-046c-48e8-adcf-befddd51d99d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:08.242075 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-21e83b9f-046c-48e8-adcf-befddd51d99d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:08.244513 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-21e83b9f-046c-48e8-adcf-befddd51d99d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:08.244995 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-21e83b9f-046c-48e8-adcf-befddd51d99d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:08.396189 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-21e83b9f-046c-48e8-adcf-befddd51d99d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:08.404221 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-21e83b9f-046c-48e8-adcf-befddd51d99d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:08.406241 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-21e83b9f-046c-48e8-adcf-befddd51d99d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:08.407398 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-21e83b9f-046c-48e8-adcf-befddd51d99d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1722 microversion: 2.20 time: 0.187223 Jul 05 16:11:08.407960 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 143/296] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:08 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:11:09.094417 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-163d4ef9-b4c5-4d57-8f9e-c356d30f0553 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Action: 'create', calling method: .version_select at 0x7f3094049040>, body: {"keypair": {"name": "tempest-keypair-1345371644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFM7rpEvX+0olTJU659q4jewwQ0AVORpmS0CruwTOmRg6YW9kofY7TMobdf6XcIbtcL+3SVP+dc+3ccv9StbnZqQtj7CqYwwNDx43dzcDFRbqVEXCP3NrbfMPzpI7B11g=="}} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:11:09.113364 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.quota [None req-163d4ef9-b4c5-4d57-8f9e-c356d30f0553 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Getting quotas for project 42e6ad67dbf542528726c545872ac10c. Resources: {'key_pairs'} {{(pid=118319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:11:09.118618 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.quota [None req-163d4ef9-b4c5-4d57-8f9e-c356d30f0553 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Getting quotas for user 0c8512e7c1704fac9cc4fcfe3bf1f18b and project 42e6ad67dbf542528726c545872ac10c. Resources: {'key_pairs'} {{(pid=118319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:11:09.219989 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-163d4ef9-b4c5-4d57-8f9e-c356d30f0553 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.129458 Jul 05 16:11:09.220518 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 154/297] 10.222.0.45 () {60 vars in 1158 bytes} [Tue Jul 5 16:11:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:11:09.426659 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-a31f4ac6-4be8-48f0-a18a-b28abcd60f3c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:09.427377 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-a31f4ac6-4be8-48f0-a18a-b28abcd60f3c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:09.433709 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a31f4ac6-4be8-48f0-a18a-b28abcd60f3c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:09.434168 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a31f4ac6-4be8-48f0-a18a-b28abcd60f3c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:09.434927 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a31f4ac6-4be8-48f0-a18a-b28abcd60f3c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:09.435369 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a31f4ac6-4be8-48f0-a18a-b28abcd60f3c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:09.573042 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-a31f4ac6-4be8-48f0-a18a-b28abcd60f3c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:09.581308 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-a31f4ac6-4be8-48f0-a18a-b28abcd60f3c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:09.582823 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-a31f4ac6-4be8-48f0-a18a-b28abcd60f3c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:09.584022 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-a31f4ac6-4be8-48f0-a18a-b28abcd60f3c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1722 microversion: 2.20 time: 0.162932 Jul 05 16:11:09.584673 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 144/298] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:09 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:11:10.159823 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-820c8e35-c785-409a-9162-61407b2cf17d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1491546828", "imageRef": "c5805086-2ebd-4742-8185-f79894fef91e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d875afbf-ed35-412f-bb5d-c579562ff61a"}], "security_groups": [{"name": "tempest-securitygroup--199954343"}], "key_name": "tempest-keypair-407624647", "user_data": "}} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:11:10.298918 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.network.neutron [None req-820c8e35-c785-409a-9162-61407b2cf17d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] validate_networks() for [('d875afbf-ed35-412f-bb5d-c579562ff61a', None, None, None, None, None)] {{(pid=118319) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 16:11:10.606179 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-defc2895-68ae-4996-880a-1737b5d30fd9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:10.609717 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-defc2895-68ae-4996-880a-1737b5d30fd9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:10.619938 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-defc2895-68ae-4996-880a-1737b5d30fd9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:10.620947 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-defc2895-68ae-4996-880a-1737b5d30fd9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:10.621774 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-defc2895-68ae-4996-880a-1737b5d30fd9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:10.622241 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-defc2895-68ae-4996-880a-1737b5d30fd9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:10.813944 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-820c8e35-c785-409a-9162-61407b2cf17d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Flavor limits 0:0:0 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 16:11:10.813944 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-820c8e35-c785-409a-9162-61407b2cf17d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Image limits 0:0:0 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 16:11:10.813944 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-820c8e35-c785-409a-9162-61407b2cf17d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Flavor pref 0:0:0 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 16:11:10.813944 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-820c8e35-c785-409a-9162-61407b2cf17d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Image pref 0:0:0 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 16:11:10.813944 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-820c8e35-c785-409a-9162-61407b2cf17d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 16:11:10.823181 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-820c8e35-c785-409a-9162-61407b2cf17d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:10.823951 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-820c8e35-c785-409a-9162-61407b2cf17d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:10.826199 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-820c8e35-c785-409a-9162-61407b2cf17d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:10.827186 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-820c8e35-c785-409a-9162-61407b2cf17d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:10.841305 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-defc2895-68ae-4996-880a-1737b5d30fd9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:10.850345 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.quota [None req-820c8e35-c785-409a-9162-61407b2cf17d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Getting quotas for project bbe6a2de3cba4aa7b365f30f5b2f745c. Resources: {'ram', 'instances', 'cores'} {{(pid=118319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:11:10.851831 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-defc2895-68ae-4996-880a-1737b5d30fd9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:10.853453 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-defc2895-68ae-4996-880a-1737b5d30fd9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:10.854664 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-defc2895-68ae-4996-880a-1737b5d30fd9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1722 microversion: 2.20 time: 0.255583 Jul 05 16:11:10.855388 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 145/299] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:10 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:11:10.857050 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.quota [None req-820c8e35-c785-409a-9162-61407b2cf17d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Getting quotas for user 8b6e665914774eabba120e986e6bb282 and project bbe6a2de3cba4aa7b365f30f5b2f745c. Resources: {'ram', 'instances', 'cores'} {{(pid=118319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:11:10.869743 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-820c8e35-c785-409a-9162-61407b2cf17d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Going to run 1 instances... {{(pid=118319) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 16:11:10.872247 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-820c8e35-c785-409a-9162-61407b2cf17d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5805086-2ebd-4742-8185-f79894fef91e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 16:11:11.043306 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-820c8e35-c785-409a-9162-61407b2cf17d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.888178 Jul 05 16:11:11.049686 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 155/300] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Jul 5 16:11:10 2022] POST /compute/v2.1/servers => generated 408 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 16:11:11.056055 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-2db976b6-b182-4032-b737-3cd82f55b17f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:11.057127 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-2db976b6-b182-4032-b737-3cd82f55b17f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:11.132257 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-2db976b6-b182-4032-b737-3cd82f55b17f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:11.139988 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-2db976b6-b182-4032-b737-3cd82f55b17f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1245 microversion: 2.1 time: 0.089299 Jul 05 16:11:11.140578 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 146/301] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:11 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:11:11.875499 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-92b25600-f72b-43d0-8d1e-f8130da82bb1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:11.876119 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-92b25600-f72b-43d0-8d1e-f8130da82bb1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:11.885367 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-92b25600-f72b-43d0-8d1e-f8130da82bb1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:11.886638 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-92b25600-f72b-43d0-8d1e-f8130da82bb1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:11.887574 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-92b25600-f72b-43d0-8d1e-f8130da82bb1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:11.888104 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-92b25600-f72b-43d0-8d1e-f8130da82bb1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:12.047124 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-92b25600-f72b-43d0-8d1e-f8130da82bb1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:12.063101 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-92b25600-f72b-43d0-8d1e-f8130da82bb1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:12.066344 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-92b25600-f72b-43d0-8d1e-f8130da82bb1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:12.067774 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-92b25600-f72b-43d0-8d1e-f8130da82bb1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1722 microversion: 2.20 time: 0.198032 Jul 05 16:11:12.088927 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 156/302] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:11 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:11:12.180985 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-52d4e40a-e1df-4fb4-ba25-3d535a6b2790 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:12.181701 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-52d4e40a-e1df-4fb4-ba25-3d535a6b2790 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:12.194157 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-52d4e40a-e1df-4fb4-ba25-3d535a6b2790 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:12.194707 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-52d4e40a-e1df-4fb4-ba25-3d535a6b2790 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:12.195681 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-52d4e40a-e1df-4fb4-ba25-3d535a6b2790 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:12.196775 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-52d4e40a-e1df-4fb4-ba25-3d535a6b2790 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:12.259033 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-52d4e40a-e1df-4fb4-ba25-3d535a6b2790 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:12.269816 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-52d4e40a-e1df-4fb4-ba25-3d535a6b2790 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1249 microversion: 2.1 time: 0.116441 Jul 05 16:11:12.270384 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 147/303] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:12 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1249 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:12.273206 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-335cd103-b662-43f1-9cb6-ab3420f02bf7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1198135205", "imageRef": "c5805086-2ebd-4742-8185-f79894fef91e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "77ec7356-4bd9-42af-abe3-f1b9c525bdef"}], "security_groups": [{"name": "tempest-securitygroup--680095006"}], "key_name": "tempest-keypair-1345371644", "user_data": "}} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:11:12.377086 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.network.neutron [None req-335cd103-b662-43f1-9cb6-ab3420f02bf7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] validate_networks() for [('77ec7356-4bd9-42af-abe3-f1b9c525bdef', None, None, None, None, None)] {{(pid=118319) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 16:11:12.826915 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-335cd103-b662-43f1-9cb6-ab3420f02bf7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Flavor limits 0:0:0 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 16:11:12.827335 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-335cd103-b662-43f1-9cb6-ab3420f02bf7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Image limits 0:0:0 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 16:11:12.827825 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-335cd103-b662-43f1-9cb6-ab3420f02bf7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Flavor pref 0:0:0 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 16:11:12.828212 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-335cd103-b662-43f1-9cb6-ab3420f02bf7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Image pref 0:0:0 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 16:11:12.828621 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-335cd103-b662-43f1-9cb6-ab3420f02bf7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 16:11:12.838672 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-335cd103-b662-43f1-9cb6-ab3420f02bf7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:12.839270 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-335cd103-b662-43f1-9cb6-ab3420f02bf7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:12.840080 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-335cd103-b662-43f1-9cb6-ab3420f02bf7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:12.840594 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-335cd103-b662-43f1-9cb6-ab3420f02bf7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:12.859544 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.quota [None req-335cd103-b662-43f1-9cb6-ab3420f02bf7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Getting quotas for project 42e6ad67dbf542528726c545872ac10c. Resources: {'ram', 'instances', 'cores'} {{(pid=118319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:11:12.863390 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.quota [None req-335cd103-b662-43f1-9cb6-ab3420f02bf7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Getting quotas for user 0c8512e7c1704fac9cc4fcfe3bf1f18b and project 42e6ad67dbf542528726c545872ac10c. Resources: {'ram', 'instances', 'cores'} {{(pid=118319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:11:12.874987 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-335cd103-b662-43f1-9cb6-ab3420f02bf7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Going to run 1 instances... {{(pid=118319) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 16:11:12.877146 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-335cd103-b662-43f1-9cb6-ab3420f02bf7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 82eccf63-469a-47ea-aab4-536d6210c066] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5805086-2ebd-4742-8185-f79894fef91e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 16:11:13.023266 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-335cd103-b662-43f1-9cb6-ab3420f02bf7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.754377 Jul 05 16:11:13.024427 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 157/304] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Jul 5 16:11:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 05 16:11:13.034547 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-556dec13-7a77-4333-a4dc-e78e2a33303e tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:13.035158 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-556dec13-7a77-4333-a4dc-e78e2a33303e tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 82eccf63-469a-47ea-aab4-536d6210c066] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:13.091216 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-3595ab22-ad51-4cb0-aae2-ea6500afdc3a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:13.091963 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-3595ab22-ad51-4cb0-aae2-ea6500afdc3a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:13.095399 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-556dec13-7a77-4333-a4dc-e78e2a33303e tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:13.102736 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-556dec13-7a77-4333-a4dc-e78e2a33303e tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066" status: 200 len: 1242 microversion: 2.1 time: 0.072065 Jul 05 16:11:13.105380 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 148/305] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:13 2022] GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066 => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:13.110238 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3595ab22-ad51-4cb0-aae2-ea6500afdc3a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:13.111776 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3595ab22-ad51-4cb0-aae2-ea6500afdc3a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:13.112731 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3595ab22-ad51-4cb0-aae2-ea6500afdc3a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:13.113499 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3595ab22-ad51-4cb0-aae2-ea6500afdc3a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:13.247837 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-3595ab22-ad51-4cb0-aae2-ea6500afdc3a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:13.255999 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-3595ab22-ad51-4cb0-aae2-ea6500afdc3a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:13.257544 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-3595ab22-ad51-4cb0-aae2-ea6500afdc3a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:13.259311 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-3595ab22-ad51-4cb0-aae2-ea6500afdc3a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1722 microversion: 2.20 time: 0.176097 Jul 05 16:11:13.259883 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 158/306] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:13 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:11:13.285662 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-e36c54f3-ccca-4a59-84ae-3632270e98a6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:13.286280 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-e36c54f3-ccca-4a59-84ae-3632270e98a6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:13.292677 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e36c54f3-ccca-4a59-84ae-3632270e98a6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:13.293162 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e36c54f3-ccca-4a59-84ae-3632270e98a6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:13.293930 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e36c54f3-ccca-4a59-84ae-3632270e98a6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:13.294369 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e36c54f3-ccca-4a59-84ae-3632270e98a6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:13.356559 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-e36c54f3-ccca-4a59-84ae-3632270e98a6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:13.364230 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-e36c54f3-ccca-4a59-84ae-3632270e98a6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1297 microversion: 2.1 time: 0.082454 Jul 05 16:11:13.365095 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 149/307] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:13 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1297 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:14.122498 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-7cb08c68-e055-4ee5-8f9d-61268692ae5f tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:14.123117 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-7cb08c68-e055-4ee5-8f9d-61268692ae5f tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 82eccf63-469a-47ea-aab4-536d6210c066] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:14.125814 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=8 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:11:14.130566 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7cb08c68-e055-4ee5-8f9d-61268692ae5f tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:14.131018 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7cb08c68-e055-4ee5-8f9d-61268692ae5f tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:14.131775 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7cb08c68-e055-4ee5-8f9d-61268692ae5f tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:14.132211 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7cb08c68-e055-4ee5-8f9d-61268692ae5f tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:14.192429 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-7cb08c68-e055-4ee5-8f9d-61268692ae5f tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:14.199648 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-7cb08c68-e055-4ee5-8f9d-61268692ae5f tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066" status: 200 len: 1246 microversion: 2.1 time: 0.080970 Jul 05 16:11:14.200220 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 159/308] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:14 2022] GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:11:14.277838 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-239e0a22-2bf0-4fad-8fc5-a87099a4dc63 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:14.278451 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-239e0a22-2bf0-4fad-8fc5-a87099a4dc63 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:14.284375 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-239e0a22-2bf0-4fad-8fc5-a87099a4dc63 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:14.284879 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-239e0a22-2bf0-4fad-8fc5-a87099a4dc63 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:14.285645 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-239e0a22-2bf0-4fad-8fc5-a87099a4dc63 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:14.286081 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-239e0a22-2bf0-4fad-8fc5-a87099a4dc63 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:14.381301 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-13d5584e-bd51-469e-ac79-e8d124b20bfe tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:14.381841 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-13d5584e-bd51-469e-ac79-e8d124b20bfe tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:14.387783 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-13d5584e-bd51-469e-ac79-e8d124b20bfe tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:14.388235 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-13d5584e-bd51-469e-ac79-e8d124b20bfe tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:14.389090 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-13d5584e-bd51-469e-ac79-e8d124b20bfe tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:14.389558 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-13d5584e-bd51-469e-ac79-e8d124b20bfe tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:14.412316 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-239e0a22-2bf0-4fad-8fc5-a87099a4dc63 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:14.420917 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-239e0a22-2bf0-4fad-8fc5-a87099a4dc63 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:14.422452 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-239e0a22-2bf0-4fad-8fc5-a87099a4dc63 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:14.423594 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-239e0a22-2bf0-4fad-8fc5-a87099a4dc63 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1722 microversion: 2.20 time: 0.150259 Jul 05 16:11:14.424149 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 150/309] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:14 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:11:14.450057 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-13d5584e-bd51-469e-ac79-e8d124b20bfe tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:14.457368 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-13d5584e-bd51-469e-ac79-e8d124b20bfe tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1297 microversion: 2.1 time: 0.080050 Jul 05 16:11:14.457930 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 160/310] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:14 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1297 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:11:15.215499 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-07e8dd4d-b1e6-44ff-a201-a0abf13b3a1b tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:15.216115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-07e8dd4d-b1e6-44ff-a201-a0abf13b3a1b tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 82eccf63-469a-47ea-aab4-536d6210c066] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:15.222089 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-07e8dd4d-b1e6-44ff-a201-a0abf13b3a1b tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:15.222539 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-07e8dd4d-b1e6-44ff-a201-a0abf13b3a1b tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:15.223297 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-07e8dd4d-b1e6-44ff-a201-a0abf13b3a1b tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:15.223733 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-07e8dd4d-b1e6-44ff-a201-a0abf13b3a1b tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:15.286569 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-07e8dd4d-b1e6-44ff-a201-a0abf13b3a1b tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:15.299789 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-07e8dd4d-b1e6-44ff-a201-a0abf13b3a1b tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066" status: 200 len: 1246 microversion: 2.1 time: 0.083493 Jul 05 16:11:15.299789 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 151/311] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:15 2022] GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:15.441570 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-271b09eb-aada-4f42-9b0b-c05f7bf61baf tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:15.442255 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-271b09eb-aada-4f42-9b0b-c05f7bf61baf tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:15.449330 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-271b09eb-aada-4f42-9b0b-c05f7bf61baf tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:15.449769 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-271b09eb-aada-4f42-9b0b-c05f7bf61baf tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:15.450518 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-271b09eb-aada-4f42-9b0b-c05f7bf61baf tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:15.450979 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-271b09eb-aada-4f42-9b0b-c05f7bf61baf tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:15.474322 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-096c10cb-4113-4d46-b757-52da5c25e120 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:15.474934 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-096c10cb-4113-4d46-b757-52da5c25e120 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:15.481431 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-096c10cb-4113-4d46-b757-52da5c25e120 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:15.481877 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-096c10cb-4113-4d46-b757-52da5c25e120 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:15.482834 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-096c10cb-4113-4d46-b757-52da5c25e120 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:15.483276 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-096c10cb-4113-4d46-b757-52da5c25e120 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:15.553860 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-096c10cb-4113-4d46-b757-52da5c25e120 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:15.561775 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-096c10cb-4113-4d46-b757-52da5c25e120 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1297 microversion: 2.1 time: 0.091230 Jul 05 16:11:15.562531 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 152/312] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:15 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1297 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:11:15.600039 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-271b09eb-aada-4f42-9b0b-c05f7bf61baf tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:15.608941 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-271b09eb-aada-4f42-9b0b-c05f7bf61baf tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:15.610783 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-271b09eb-aada-4f42-9b0b-c05f7bf61baf tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:15.612082 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-271b09eb-aada-4f42-9b0b-c05f7bf61baf tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1722 microversion: 2.20 time: 0.175127 Jul 05 16:11:15.612705 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 161/313] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:15 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:11:16.315401 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-61bd1031-8fc8-483b-ba75-76d0782bf388 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:16.316006 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-61bd1031-8fc8-483b-ba75-76d0782bf388 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 82eccf63-469a-47ea-aab4-536d6210c066] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:16.323351 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-61bd1031-8fc8-483b-ba75-76d0782bf388 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:16.324635 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-61bd1031-8fc8-483b-ba75-76d0782bf388 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:16.324635 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-61bd1031-8fc8-483b-ba75-76d0782bf388 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:16.325080 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-61bd1031-8fc8-483b-ba75-76d0782bf388 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:16.409077 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-61bd1031-8fc8-483b-ba75-76d0782bf388 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:16.418916 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-61bd1031-8fc8-483b-ba75-76d0782bf388 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066" status: 200 len: 1294 microversion: 2.1 time: 0.107525 Jul 05 16:11:16.419419 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 153/314] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:16 2022] GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066 => generated 1294 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:16.578522 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-4ae82fa3-419b-4ade-8c27-d64838e17061 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:16.579143 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-4ae82fa3-419b-4ade-8c27-d64838e17061 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:16.587611 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-4ae82fa3-419b-4ade-8c27-d64838e17061 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:16.588071 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-4ae82fa3-419b-4ade-8c27-d64838e17061 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:16.588910 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-4ae82fa3-419b-4ade-8c27-d64838e17061 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:16.589421 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-4ae82fa3-419b-4ade-8c27-d64838e17061 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:16.631436 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-d68b9fb5-b73d-40ba-ba4d-26847ffef145 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:16.632611 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-d68b9fb5-b73d-40ba-ba4d-26847ffef145 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:16.643451 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d68b9fb5-b73d-40ba-ba4d-26847ffef145 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:16.643894 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d68b9fb5-b73d-40ba-ba4d-26847ffef145 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:16.646856 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d68b9fb5-b73d-40ba-ba4d-26847ffef145 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:16.647307 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d68b9fb5-b73d-40ba-ba4d-26847ffef145 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:16.671972 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-4ae82fa3-419b-4ade-8c27-d64838e17061 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:16.675387 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:11:16.680234 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-4ae82fa3-419b-4ade-8c27-d64838e17061 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1303 microversion: 2.1 time: 0.105880 Jul 05 16:11:16.680846 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 162/315] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:16 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1303 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:16.846072 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-d68b9fb5-b73d-40ba-ba4d-26847ffef145 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:16.864740 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-d68b9fb5-b73d-40ba-ba4d-26847ffef145 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:16.867868 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-d68b9fb5-b73d-40ba-ba4d-26847ffef145 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:16.869493 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-d68b9fb5-b73d-40ba-ba4d-26847ffef145 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1722 microversion: 2.20 time: 0.241903 Jul 05 16:11:16.876147 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 154/316] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:16 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:11:17.439949 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-971ac58c-d993-4205-8e48-99e6f9441515 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:17.440073 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-971ac58c-d993-4205-8e48-99e6f9441515 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 82eccf63-469a-47ea-aab4-536d6210c066] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:17.452243 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-971ac58c-d993-4205-8e48-99e6f9441515 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:17.453180 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-971ac58c-d993-4205-8e48-99e6f9441515 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:17.454381 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-971ac58c-d993-4205-8e48-99e6f9441515 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:17.455469 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-971ac58c-d993-4205-8e48-99e6f9441515 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:17.702015 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-1b775468-1ba3-4ec9-b17a-27264aa3ab8e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:17.702015 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-1b775468-1ba3-4ec9-b17a-27264aa3ab8e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:17.702015 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_api:SELECT=54 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:11:17.703538 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-971ac58c-d993-4205-8e48-99e6f9441515 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:17.708571 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1b775468-1ba3-4ec9-b17a-27264aa3ab8e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:17.709414 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1b775468-1ba3-4ec9-b17a-27264aa3ab8e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:17.710620 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1b775468-1ba3-4ec9-b17a-27264aa3ab8e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:17.711296 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1b775468-1ba3-4ec9-b17a-27264aa3ab8e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:17.712166 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-971ac58c-d993-4205-8e48-99e6f9441515 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066" status: 200 len: 1294 microversion: 2.1 time: 0.279550 Jul 05 16:11:17.712831 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 163/317] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:17 2022] GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066 => generated 1294 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:17.907021 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-09c3467e-4c90-4f0b-a950-2beee5abac62 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:17.907979 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-09c3467e-4c90-4f0b-a950-2beee5abac62 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:17.916860 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-09c3467e-4c90-4f0b-a950-2beee5abac62 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:17.917326 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-09c3467e-4c90-4f0b-a950-2beee5abac62 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:17.918097 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-09c3467e-4c90-4f0b-a950-2beee5abac62 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:17.918949 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-09c3467e-4c90-4f0b-a950-2beee5abac62 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:18.053521 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-1b775468-1ba3-4ec9-b17a-27264aa3ab8e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:18.061082 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-1b775468-1ba3-4ec9-b17a-27264aa3ab8e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1370 microversion: 2.1 time: 0.367451 Jul 05 16:11:18.070515 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 155/318] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:17 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1370 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:11:18.269745 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-09c3467e-4c90-4f0b-a950-2beee5abac62 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:18.280949 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-09c3467e-4c90-4f0b-a950-2beee5abac62 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:18.282827 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-09c3467e-4c90-4f0b-a950-2beee5abac62 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:18.284132 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-09c3467e-4c90-4f0b-a950-2beee5abac62 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1722 microversion: 2.20 time: 0.381782 Jul 05 16:11:18.284779 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 164/319] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:17 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1722 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:11:18.649856 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-2f83830f-a89f-4e0c-8e37-d7dd090c797f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:11:18.656642 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2f83830f-a89f-4e0c-8e37-d7dd090c797f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:18.657166 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2f83830f-a89f-4e0c-8e37-d7dd090c797f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:18.728643 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-3e00b72a-b12a-4ed7-9dd6-027049213da1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:18.734651 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-3e00b72a-b12a-4ed7-9dd6-027049213da1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 82eccf63-469a-47ea-aab4-536d6210c066] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:18.746369 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3e00b72a-b12a-4ed7-9dd6-027049213da1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:18.746825 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3e00b72a-b12a-4ed7-9dd6-027049213da1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:18.747613 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3e00b72a-b12a-4ed7-9dd6-027049213da1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:18.748231 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3e00b72a-b12a-4ed7-9dd6-027049213da1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:18.750984 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-2f83830f-a89f-4e0c-8e37-d7dd090c797f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Going to try to stop instance {{(pid=118320) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 05 16:11:18.852531 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-3e00b72a-b12a-4ed7-9dd6-027049213da1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:18.860618 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-3e00b72a-b12a-4ed7-9dd6-027049213da1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066" status: 200 len: 1300 microversion: 2.1 time: 0.135953 Jul 05 16:11:18.861292 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 165/320] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:18 2022] GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066 => generated 1300 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:11:19.005229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-2f83830f-a89f-4e0c-8e37-d7dd090c797f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "POST /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74/action" status: 202 len: 0 microversion: 2.1 time: 0.359584 Jul 05 16:11:19.006561 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 156/321] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Jul 5 16:11:18 2022] POST /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 16:11:19.016182 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-585821de-2dde-49ee-a3b4-22b081ec6e6f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:19.020076 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-585821de-2dde-49ee-a3b4-22b081ec6e6f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:19.038401 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-585821de-2dde-49ee-a3b4-22b081ec6e6f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:19.042997 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-585821de-2dde-49ee-a3b4-22b081ec6e6f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:19.042997 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-585821de-2dde-49ee-a3b4-22b081ec6e6f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:19.042997 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-585821de-2dde-49ee-a3b4-22b081ec6e6f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:19.054661 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-4bc106d7-816c-4919-923d-601d3d68d7b4 req-0c5e1015-342f-4f27-8638-484638ec2350 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42be8657-fc50-4057-b373-e7bcf984e261", "tag": "81587e02-fcd0-4999-9ed7-aae4729b5548"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:11:19.072117 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-4bc106d7-816c-4919-923d-601d3d68d7b4 req-0c5e1015-342f-4f27-8638-484638ec2350 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:19.077603 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-4bc106d7-816c-4919-923d-601d3d68d7b4 req-0c5e1015-342f-4f27-8638-484638ec2350 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:19.122503 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-4bc106d7-816c-4919-923d-601d3d68d7b4 req-0c5e1015-342f-4f27-8638-484638ec2350 service nova] Creating event network-changed:81587e02-fcd0-4999-9ed7-aae4729b5548 for instance 42be8657-fc50-4057-b373-e7bcf984e261 on hv-cinder-84875 Jul 05 16:11:19.128480 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-4bc106d7-816c-4919-923d-601d3d68d7b4 req-0c5e1015-342f-4f27-8638-484638ec2350 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077767 Jul 05 16:11:19.129679 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 157/322] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:11:19.137565 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-23419daf-99d6-4098-865c-573e5d7b3448 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:19.138587 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-23419daf-99d6-4098-865c-573e5d7b3448 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:19.153229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-23419daf-99d6-4098-865c-573e5d7b3448 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:19.153735 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-23419daf-99d6-4098-865c-573e5d7b3448 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:19.154542 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-23419daf-99d6-4098-865c-573e5d7b3448 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:19.155148 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-23419daf-99d6-4098-865c-573e5d7b3448 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:19.270431 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-585821de-2dde-49ee-a3b4-22b081ec6e6f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:19.281697 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-585821de-2dde-49ee-a3b4-22b081ec6e6f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1721 microversion: 2.1 time: 0.270213 Jul 05 16:11:19.283176 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 166/323] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:19 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1721 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:19.305526 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-78e07762-77de-4da0-bf80-8bc3a28dac75 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:19.306299 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-78e07762-77de-4da0-bf80-8bc3a28dac75 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:19.313066 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-78e07762-77de-4da0-bf80-8bc3a28dac75 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:19.313640 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-78e07762-77de-4da0-bf80-8bc3a28dac75 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:19.314516 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-78e07762-77de-4da0-bf80-8bc3a28dac75 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:19.315050 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-78e07762-77de-4da0-bf80-8bc3a28dac75 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:19.588866 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-23419daf-99d6-4098-865c-573e5d7b3448 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:19.600317 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-23419daf-99d6-4098-865c-573e5d7b3448 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1370 microversion: 2.1 time: 0.465488 Jul 05 16:11:19.600317 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 158/324] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:19 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1370 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:19.691530 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-78e07762-77de-4da0-bf80-8bc3a28dac75 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:19.700431 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-78e07762-77de-4da0-bf80-8bc3a28dac75 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:19.701964 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-78e07762-77de-4da0-bf80-8bc3a28dac75 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:19.703123 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-78e07762-77de-4da0-bf80-8bc3a28dac75 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1722 microversion: 2.20 time: 0.403155 Jul 05 16:11:19.703747 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 167/325] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:19 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1722 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:11:19.878412 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-dcaf7856-2a33-4cab-bf59-13037ac55501 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:19.879032 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-dcaf7856-2a33-4cab-bf59-13037ac55501 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 82eccf63-469a-47ea-aab4-536d6210c066] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:19.894804 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dcaf7856-2a33-4cab-bf59-13037ac55501 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:19.894804 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dcaf7856-2a33-4cab-bf59-13037ac55501 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:19.894804 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dcaf7856-2a33-4cab-bf59-13037ac55501 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:19.895542 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dcaf7856-2a33-4cab-bf59-13037ac55501 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:19.901988 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:11:20.200245 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-dcaf7856-2a33-4cab-bf59-13037ac55501 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:20.209142 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-dcaf7856-2a33-4cab-bf59-13037ac55501 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066" status: 200 len: 1367 microversion: 2.1 time: 0.334657 Jul 05 16:11:20.219095 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 159/326] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:19 2022] GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066 => generated 1367 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:20.302693 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-f95f1409-4256-4ad5-a14d-7c069a5f5373 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:20.303456 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-f95f1409-4256-4ad5-a14d-7c069a5f5373 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:20.311056 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f95f1409-4256-4ad5-a14d-7c069a5f5373 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:20.311497 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f95f1409-4256-4ad5-a14d-7c069a5f5373 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:20.312268 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f95f1409-4256-4ad5-a14d-7c069a5f5373 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:20.312700 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f95f1409-4256-4ad5-a14d-7c069a5f5373 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:20.483058 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-f95f1409-4256-4ad5-a14d-7c069a5f5373 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:20.491463 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-f95f1409-4256-4ad5-a14d-7c069a5f5373 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1721 microversion: 2.1 time: 0.195159 Jul 05 16:11:20.492034 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 168/327] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:20 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:20.614461 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-28abb8c0-cf4c-4084-810a-6408298496ea tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:20.615163 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-28abb8c0-cf4c-4084-810a-6408298496ea tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:20.622180 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-28abb8c0-cf4c-4084-810a-6408298496ea tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:20.622839 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-28abb8c0-cf4c-4084-810a-6408298496ea tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:20.630764 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-28abb8c0-cf4c-4084-810a-6408298496ea tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:20.630764 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-28abb8c0-cf4c-4084-810a-6408298496ea tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:20.727083 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-970635ee-b1aa-48e0-87d4-c6dfb59ee38a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:20.728198 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-970635ee-b1aa-48e0-87d4-c6dfb59ee38a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:20.740549 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-970635ee-b1aa-48e0-87d4-c6dfb59ee38a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:20.741507 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-970635ee-b1aa-48e0-87d4-c6dfb59ee38a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:20.742833 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-970635ee-b1aa-48e0-87d4-c6dfb59ee38a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:20.743460 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-970635ee-b1aa-48e0-87d4-c6dfb59ee38a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:20.932898 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-28abb8c0-cf4c-4084-810a-6408298496ea tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:20.942249 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-28abb8c0-cf4c-4084-810a-6408298496ea tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1370 microversion: 2.1 time: 0.333017 Jul 05 16:11:20.943269 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 160/328] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:20 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1370 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:20.969391 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-970635ee-b1aa-48e0-87d4-c6dfb59ee38a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:20.993871 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-970635ee-b1aa-48e0-87d4-c6dfb59ee38a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:21.004412 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-970635ee-b1aa-48e0-87d4-c6dfb59ee38a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:21.007210 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-970635ee-b1aa-48e0-87d4-c6dfb59ee38a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1722 microversion: 2.20 time: 0.290015 Jul 05 16:11:21.008848 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 169/329] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:20 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1722 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:11:21.167955 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-0d55bd6e-ff6e-4c12-ab0c-2e360587da3f req-297af958-1609-46da-a3eb-14d6aabd8bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82eccf63-469a-47ea-aab4-536d6210c066", "tag": "54f02c5c-3943-4041-9d1e-31e3fcfcdf17"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:11:21.177942 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-0d55bd6e-ff6e-4c12-ab0c-2e360587da3f req-297af958-1609-46da-a3eb-14d6aabd8bf9 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:21.178385 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-0d55bd6e-ff6e-4c12-ab0c-2e360587da3f req-297af958-1609-46da-a3eb-14d6aabd8bf9 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:21.191285 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-0d55bd6e-ff6e-4c12-ab0c-2e360587da3f req-297af958-1609-46da-a3eb-14d6aabd8bf9 service nova] Creating event network-changed:54f02c5c-3943-4041-9d1e-31e3fcfcdf17 for instance 82eccf63-469a-47ea-aab4-536d6210c066 on hv-cinder-84875 Jul 05 16:11:21.197391 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-0d55bd6e-ff6e-4c12-ab0c-2e360587da3f req-297af958-1609-46da-a3eb-14d6aabd8bf9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037781 Jul 05 16:11:21.198207 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 161/330] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:11:21.228408 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-527ba648-118f-42b0-acfd-2df7a7729afa tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:21.229641 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-527ba648-118f-42b0-acfd-2df7a7729afa tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 82eccf63-469a-47ea-aab4-536d6210c066] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:21.239436 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-527ba648-118f-42b0-acfd-2df7a7729afa tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:21.241632 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-527ba648-118f-42b0-acfd-2df7a7729afa tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:21.254438 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-527ba648-118f-42b0-acfd-2df7a7729afa tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:21.254974 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-527ba648-118f-42b0-acfd-2df7a7729afa tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:21.509888 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-38e0ee79-a8c5-44fa-95d1-c188b8d6ddb2 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:21.514898 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-38e0ee79-a8c5-44fa-95d1-c188b8d6ddb2 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:21.515595 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-527ba648-118f-42b0-acfd-2df7a7729afa tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:21.525808 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-527ba648-118f-42b0-acfd-2df7a7729afa tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066" status: 200 len: 1367 microversion: 2.1 time: 0.303746 Jul 05 16:11:21.529646 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-38e0ee79-a8c5-44fa-95d1-c188b8d6ddb2 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:21.539516 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 170/331] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:21 2022] GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066 => generated 1367 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:21.540278 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-38e0ee79-a8c5-44fa-95d1-c188b8d6ddb2 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:21.541331 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-38e0ee79-a8c5-44fa-95d1-c188b8d6ddb2 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:21.541843 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-38e0ee79-a8c5-44fa-95d1-c188b8d6ddb2 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:21.962990 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-0268b009-c0e3-4285-a2c9-ef9817e856ec tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:21.963640 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-0268b009-c0e3-4285-a2c9-ef9817e856ec tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:21.970203 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0268b009-c0e3-4285-a2c9-ef9817e856ec tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:21.970651 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0268b009-c0e3-4285-a2c9-ef9817e856ec tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:21.971421 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0268b009-c0e3-4285-a2c9-ef9817e856ec tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:21.971862 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0268b009-c0e3-4285-a2c9-ef9817e856ec tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:22.127741 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-38e0ee79-a8c5-44fa-95d1-c188b8d6ddb2 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:22.139432 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-38e0ee79-a8c5-44fa-95d1-c188b8d6ddb2 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1721 microversion: 2.1 time: 0.634171 Jul 05 16:11:22.140453 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 162/332] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:21 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1721 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:22.147087 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-3658dbb4-fa78-49ee-a2a6-e4191dda97a1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:22.148015 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-3658dbb4-fa78-49ee-a2a6-e4191dda97a1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:22.156411 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3658dbb4-fa78-49ee-a2a6-e4191dda97a1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:22.157110 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3658dbb4-fa78-49ee-a2a6-e4191dda97a1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:22.158308 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3658dbb4-fa78-49ee-a2a6-e4191dda97a1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:22.159036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3658dbb4-fa78-49ee-a2a6-e4191dda97a1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:22.367803 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-0268b009-c0e3-4285-a2c9-ef9817e856ec tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:22.375352 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-0268b009-c0e3-4285-a2c9-ef9817e856ec tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1370 microversion: 2.1 time: 0.417127 Jul 05 16:11:22.385406 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 171/333] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:21 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1370 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:22.498295 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-3658dbb4-fa78-49ee-a2a6-e4191dda97a1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:22.513018 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-3658dbb4-fa78-49ee-a2a6-e4191dda97a1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:22.515280 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-3658dbb4-fa78-49ee-a2a6-e4191dda97a1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:22.517876 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-3658dbb4-fa78-49ee-a2a6-e4191dda97a1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1722 microversion: 2.20 time: 0.375748 Jul 05 16:11:22.528859 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 163/334] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:22 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1722 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:11:22.549656 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-10beed70-c376-49ba-9d03-7feaf6743dbb tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:22.550603 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-10beed70-c376-49ba-9d03-7feaf6743dbb tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 82eccf63-469a-47ea-aab4-536d6210c066] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:22.560275 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-10beed70-c376-49ba-9d03-7feaf6743dbb tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:22.561139 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-10beed70-c376-49ba-9d03-7feaf6743dbb tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:22.562475 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-10beed70-c376-49ba-9d03-7feaf6743dbb tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:22.563325 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-10beed70-c376-49ba-9d03-7feaf6743dbb tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:22.849206 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell0:SELECT=4 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:11:22.870912 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell0:SELECT=20 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:11:22.880958 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-10beed70-c376-49ba-9d03-7feaf6743dbb tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:22.910961 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-10beed70-c376-49ba-9d03-7feaf6743dbb tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066" status: 200 len: 1367 microversion: 2.1 time: 0.361650 Jul 05 16:11:22.928998 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 172/335] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:22 2022] GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066 => generated 1367 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:23.158912 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-fbe32d95-45fd-47a9-b689-44015d3c1340 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:23.160610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-fbe32d95-45fd-47a9-b689-44015d3c1340 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:23.164143 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell0:SELECT=4 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:11:23.169782 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fbe32d95-45fd-47a9-b689-44015d3c1340 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:23.170304 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fbe32d95-45fd-47a9-b689-44015d3c1340 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:23.171087 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fbe32d95-45fd-47a9-b689-44015d3c1340 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:23.171789 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fbe32d95-45fd-47a9-b689-44015d3c1340 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:23.368347 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-fbe32d95-45fd-47a9-b689-44015d3c1340 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:23.384509 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-fbe32d95-45fd-47a9-b689-44015d3c1340 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1721 microversion: 2.1 time: 0.223161 Jul 05 16:11:23.385415 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 164/336] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:23 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:23.398978 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-6de69692-0265-4851-80e7-0ce9add1ffcc tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:23.399589 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-6de69692-0265-4851-80e7-0ce9add1ffcc tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:23.416665 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-6de69692-0265-4851-80e7-0ce9add1ffcc tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:23.417237 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-6de69692-0265-4851-80e7-0ce9add1ffcc tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:23.418282 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-6de69692-0265-4851-80e7-0ce9add1ffcc tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:23.418723 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-6de69692-0265-4851-80e7-0ce9add1ffcc tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:23.536241 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-a06640fc-25d9-43c4-83ee-4aa8dbe653ab tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:23.537008 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-a06640fc-25d9-43c4-83ee-4aa8dbe653ab tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:23.544702 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a06640fc-25d9-43c4-83ee-4aa8dbe653ab tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:23.545282 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a06640fc-25d9-43c4-83ee-4aa8dbe653ab tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:23.546124 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a06640fc-25d9-43c4-83ee-4aa8dbe653ab tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:23.546762 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a06640fc-25d9-43c4-83ee-4aa8dbe653ab tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:23.558816 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-6de69692-0265-4851-80e7-0ce9add1ffcc tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:23.571371 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-6de69692-0265-4851-80e7-0ce9add1ffcc tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1370 microversion: 2.1 time: 0.176618 Jul 05 16:11:23.571973 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 173/337] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:23 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:23.684123 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-a06640fc-25d9-43c4-83ee-4aa8dbe653ab tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:23.702852 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-a06640fc-25d9-43c4-83ee-4aa8dbe653ab tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:23.704510 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-a06640fc-25d9-43c4-83ee-4aa8dbe653ab tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:23.705794 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-a06640fc-25d9-43c4-83ee-4aa8dbe653ab tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1722 microversion: 2.20 time: 0.174135 Jul 05 16:11:23.706427 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 165/338] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:23 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:11:23.928365 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-9193b7aa-d0c0-4e9f-96ed-1496ca579794 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:23.929003 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-9193b7aa-d0c0-4e9f-96ed-1496ca579794 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 82eccf63-469a-47ea-aab4-536d6210c066] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:23.936489 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9193b7aa-d0c0-4e9f-96ed-1496ca579794 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:23.936959 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9193b7aa-d0c0-4e9f-96ed-1496ca579794 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:23.937935 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9193b7aa-d0c0-4e9f-96ed-1496ca579794 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:23.938368 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9193b7aa-d0c0-4e9f-96ed-1496ca579794 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:24.080788 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-9193b7aa-d0c0-4e9f-96ed-1496ca579794 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:24.088924 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-9193b7aa-d0c0-4e9f-96ed-1496ca579794 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066" status: 200 len: 1367 microversion: 2.1 time: 0.164326 Jul 05 16:11:24.089683 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 174/339] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:23 2022] GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:24.402630 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-67622311-35ce-4e3b-a1f6-df8080346637 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:24.403943 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-67622311-35ce-4e3b-a1f6-df8080346637 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:24.412968 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-67622311-35ce-4e3b-a1f6-df8080346637 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:24.413508 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-67622311-35ce-4e3b-a1f6-df8080346637 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:24.414867 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-67622311-35ce-4e3b-a1f6-df8080346637 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:24.415531 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-67622311-35ce-4e3b-a1f6-df8080346637 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:24.565134 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-67622311-35ce-4e3b-a1f6-df8080346637 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:24.573440 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-67622311-35ce-4e3b-a1f6-df8080346637 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1721 microversion: 2.1 time: 0.175053 Jul 05 16:11:24.574067 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 166/340] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:24 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:24.589262 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-956de7d8-b621-4a31-aa2f-594e6d75e4a4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:24.589886 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-956de7d8-b621-4a31-aa2f-594e6d75e4a4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:24.598341 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-956de7d8-b621-4a31-aa2f-594e6d75e4a4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:24.599140 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-956de7d8-b621-4a31-aa2f-594e6d75e4a4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:24.602065 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-956de7d8-b621-4a31-aa2f-594e6d75e4a4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:24.602065 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-956de7d8-b621-4a31-aa2f-594e6d75e4a4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:24.725566 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-f0697a60-6ba4-4842-9522-7573ee3e5b52 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:24.726189 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-f0697a60-6ba4-4842-9522-7573ee3e5b52 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:24.733055 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f0697a60-6ba4-4842-9522-7573ee3e5b52 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:24.733513 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f0697a60-6ba4-4842-9522-7573ee3e5b52 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:24.734556 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f0697a60-6ba4-4842-9522-7573ee3e5b52 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:24.734993 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f0697a60-6ba4-4842-9522-7573ee3e5b52 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:24.749251 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-956de7d8-b621-4a31-aa2f-594e6d75e4a4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:24.757854 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-956de7d8-b621-4a31-aa2f-594e6d75e4a4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1370 microversion: 2.1 time: 0.172631 Jul 05 16:11:24.758448 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 175/341] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:24 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:24.877564 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-f0697a60-6ba4-4842-9522-7573ee3e5b52 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:24.885895 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-f0697a60-6ba4-4842-9522-7573ee3e5b52 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:24.887414 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-f0697a60-6ba4-4842-9522-7573ee3e5b52 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:24.888583 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-f0697a60-6ba4-4842-9522-7573ee3e5b52 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1722 microversion: 2.20 time: 0.167419 Jul 05 16:11:24.889170 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 167/342] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:24 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:11:25.106122 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-7dd026e2-207b-46c8-8b48-66ba5f9b366a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:25.106741 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-7dd026e2-207b-46c8-8b48-66ba5f9b366a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 82eccf63-469a-47ea-aab4-536d6210c066] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:25.113315 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7dd026e2-207b-46c8-8b48-66ba5f9b366a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:25.113767 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7dd026e2-207b-46c8-8b48-66ba5f9b366a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:25.114537 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7dd026e2-207b-46c8-8b48-66ba5f9b366a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:25.114964 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7dd026e2-207b-46c8-8b48-66ba5f9b366a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:25.282253 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-7dd026e2-207b-46c8-8b48-66ba5f9b366a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:25.290672 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-7dd026e2-207b-46c8-8b48-66ba5f9b366a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066" status: 200 len: 1367 microversion: 2.1 time: 0.188463 Jul 05 16:11:25.293801 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 176/343] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:25 2022] GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:25.536138 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-5aa0a864-a452-4011-89f1-df60ffbdbae7 req-5c889aa2-6bf4-4a13-a18a-3601934f95da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42be8657-fc50-4057-b373-e7bcf984e261", "name": "network-vif-plugged", "status": "completed", "tag": "81587e02-fcd0-4999-9ed7-aae4729b5548"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:11:25.545372 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-5aa0a864-a452-4011-89f1-df60ffbdbae7 req-5c889aa2-6bf4-4a13-a18a-3601934f95da service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:25.545872 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-5aa0a864-a452-4011-89f1-df60ffbdbae7 req-5c889aa2-6bf4-4a13-a18a-3601934f95da service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:25.558156 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-5aa0a864-a452-4011-89f1-df60ffbdbae7 req-5c889aa2-6bf4-4a13-a18a-3601934f95da service nova] Creating event network-vif-plugged:81587e02-fcd0-4999-9ed7-aae4729b5548 for instance 42be8657-fc50-4057-b373-e7bcf984e261 on hv-cinder-84875 Jul 05 16:11:25.563025 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-5aa0a864-a452-4011-89f1-df60ffbdbae7 req-5c889aa2-6bf4-4a13-a18a-3601934f95da service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033144 Jul 05 16:11:25.563679 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 168/344] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:11:25.590854 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-3c556b98-2033-4636-ae3d-ab7eeeb4316f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:25.591499 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-3c556b98-2033-4636-ae3d-ab7eeeb4316f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:25.597889 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3c556b98-2033-4636-ae3d-ab7eeeb4316f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:25.598375 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3c556b98-2033-4636-ae3d-ab7eeeb4316f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:25.599094 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3c556b98-2033-4636-ae3d-ab7eeeb4316f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:25.599525 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3c556b98-2033-4636-ae3d-ab7eeeb4316f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:25.743161 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-3c556b98-2033-4636-ae3d-ab7eeeb4316f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:25.751135 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-3c556b98-2033-4636-ae3d-ab7eeeb4316f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1721 microversion: 2.1 time: 0.164159 Jul 05 16:11:25.751702 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 177/345] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:25 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:25.777656 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-afea5abb-a2bc-4d72-94d1-3a06f8cfbe15 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:25.777656 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-afea5abb-a2bc-4d72-94d1-3a06f8cfbe15 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:25.782924 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-afea5abb-a2bc-4d72-94d1-3a06f8cfbe15 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:25.783376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-afea5abb-a2bc-4d72-94d1-3a06f8cfbe15 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:25.784140 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-afea5abb-a2bc-4d72-94d1-3a06f8cfbe15 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:25.784578 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-afea5abb-a2bc-4d72-94d1-3a06f8cfbe15 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:25.907447 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-339ccf8c-0c08-4bfc-8c45-19e09fc8d123 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:25.908086 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-339ccf8c-0c08-4bfc-8c45-19e09fc8d123 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:25.914479 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-339ccf8c-0c08-4bfc-8c45-19e09fc8d123 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:25.914921 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-339ccf8c-0c08-4bfc-8c45-19e09fc8d123 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:25.915680 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-339ccf8c-0c08-4bfc-8c45-19e09fc8d123 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:25.916109 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-339ccf8c-0c08-4bfc-8c45-19e09fc8d123 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:25.918684 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-afea5abb-a2bc-4d72-94d1-3a06f8cfbe15 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:25.928396 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-afea5abb-a2bc-4d72-94d1-3a06f8cfbe15 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1370 microversion: 2.1 time: 0.154642 Jul 05 16:11:25.928396 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 169/346] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:25 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:26.057735 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-339ccf8c-0c08-4bfc-8c45-19e09fc8d123 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:26.066073 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-339ccf8c-0c08-4bfc-8c45-19e09fc8d123 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:26.067573 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-339ccf8c-0c08-4bfc-8c45-19e09fc8d123 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:26.068720 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-339ccf8c-0c08-4bfc-8c45-19e09fc8d123 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1722 microversion: 2.20 time: 0.165219 Jul 05 16:11:26.069290 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 178/347] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:25 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:11:26.307771 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-ddfe41a2-20ff-4cdb-a1de-32cfcc601bb1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:26.308314 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-ddfe41a2-20ff-4cdb-a1de-32cfcc601bb1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 82eccf63-469a-47ea-aab4-536d6210c066] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:26.314611 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ddfe41a2-20ff-4cdb-a1de-32cfcc601bb1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:26.315061 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ddfe41a2-20ff-4cdb-a1de-32cfcc601bb1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:26.315909 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ddfe41a2-20ff-4cdb-a1de-32cfcc601bb1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:26.316358 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ddfe41a2-20ff-4cdb-a1de-32cfcc601bb1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:26.446887 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-ddfe41a2-20ff-4cdb-a1de-32cfcc601bb1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:26.454207 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-ddfe41a2-20ff-4cdb-a1de-32cfcc601bb1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066" status: 200 len: 1367 microversion: 2.1 time: 0.150590 Jul 05 16:11:26.454770 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 170/348] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:26 2022] GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:26.768807 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-4b3f25d3-469e-48b6-85d4-74008b59537b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:26.769421 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-4b3f25d3-469e-48b6-85d4-74008b59537b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:26.776535 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-4b3f25d3-469e-48b6-85d4-74008b59537b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:26.776999 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-4b3f25d3-469e-48b6-85d4-74008b59537b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:26.777752 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-4b3f25d3-469e-48b6-85d4-74008b59537b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:26.778183 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-4b3f25d3-469e-48b6-85d4-74008b59537b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:26.795911 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell1:SELECT=100 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:11:26.906845 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-4b3f25d3-469e-48b6-85d4-74008b59537b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:26.914690 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-4b3f25d3-469e-48b6-85d4-74008b59537b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1721 microversion: 2.1 time: 0.149812 Jul 05 16:11:26.915252 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 179/349] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:26 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:26.943806 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-3788a7f7-9d66-4aee-b40a-151773278af3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:26.944423 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-3788a7f7-9d66-4aee-b40a-151773278af3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:26.951549 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3788a7f7-9d66-4aee-b40a-151773278af3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:26.952001 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3788a7f7-9d66-4aee-b40a-151773278af3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:26.952784 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3788a7f7-9d66-4aee-b40a-151773278af3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:26.953495 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3788a7f7-9d66-4aee-b40a-151773278af3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:27.087866 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-fee0109b-0b11-4625-aff9-dfba2680aaf8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:27.088502 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-fee0109b-0b11-4625-aff9-dfba2680aaf8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:27.094733 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fee0109b-0b11-4625-aff9-dfba2680aaf8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:27.095299 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fee0109b-0b11-4625-aff9-dfba2680aaf8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:27.096070 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fee0109b-0b11-4625-aff9-dfba2680aaf8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:27.096684 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fee0109b-0b11-4625-aff9-dfba2680aaf8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:27.106878 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-3788a7f7-9d66-4aee-b40a-151773278af3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:27.115209 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-3788a7f7-9d66-4aee-b40a-151773278af3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1370 microversion: 2.1 time: 0.175148 Jul 05 16:11:27.116275 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 171/350] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:26 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:27.245677 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-fee0109b-0b11-4625-aff9-dfba2680aaf8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:27.253607 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-fee0109b-0b11-4625-aff9-dfba2680aaf8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:27.255158 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-fee0109b-0b11-4625-aff9-dfba2680aaf8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:27.256514 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-fee0109b-0b11-4625-aff9-dfba2680aaf8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1722 microversion: 2.20 time: 0.173355 Jul 05 16:11:27.257107 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 180/351] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:27 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:11:27.471584 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-602c8ada-ff31-460e-8230-9ceabe5f3e74 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:27.472194 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-602c8ada-ff31-460e-8230-9ceabe5f3e74 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 82eccf63-469a-47ea-aab4-536d6210c066] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:27.478722 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-602c8ada-ff31-460e-8230-9ceabe5f3e74 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:27.479174 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-602c8ada-ff31-460e-8230-9ceabe5f3e74 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:27.479933 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-602c8ada-ff31-460e-8230-9ceabe5f3e74 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:27.480368 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-602c8ada-ff31-460e-8230-9ceabe5f3e74 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:27.635808 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-602c8ada-ff31-460e-8230-9ceabe5f3e74 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:27.643556 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-602c8ada-ff31-460e-8230-9ceabe5f3e74 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066" status: 200 len: 1367 microversion: 2.1 time: 0.175795 Jul 05 16:11:27.644165 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 172/352] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:27 2022] GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:27.931512 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-07b69258-7a6c-4c33-a697-31efb1c140cc tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:27.932140 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-07b69258-7a6c-4c33-a697-31efb1c140cc tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:27.938611 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-07b69258-7a6c-4c33-a697-31efb1c140cc tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:27.939057 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-07b69258-7a6c-4c33-a697-31efb1c140cc tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:27.939819 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-07b69258-7a6c-4c33-a697-31efb1c140cc tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:27.940256 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-07b69258-7a6c-4c33-a697-31efb1c140cc tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:28.071698 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-07b69258-7a6c-4c33-a697-31efb1c140cc tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:28.080160 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-07b69258-7a6c-4c33-a697-31efb1c140cc tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1721 microversion: 2.1 time: 0.152492 Jul 05 16:11:28.080738 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 181/353] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:27 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:28.144629 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-3dee5938-52a7-4548-83b6-242b5aed53f2 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:28.144629 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-3dee5938-52a7-4548-83b6-242b5aed53f2 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:28.144629 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3dee5938-52a7-4548-83b6-242b5aed53f2 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:28.144629 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3dee5938-52a7-4548-83b6-242b5aed53f2 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:28.145489 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3dee5938-52a7-4548-83b6-242b5aed53f2 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:28.145489 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3dee5938-52a7-4548-83b6-242b5aed53f2 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:28.188281 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-d24d9c33-9637-4ce4-9728-bee74b741a03 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1928336388", "imageRef": "c5805086-2ebd-4742-8185-f79894fef91e", "flavorRef": "452", "networks": [{"uuid": "143ca51d-04c4-49d1-b023-9392fa41c485"}]}} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:11:28.241494 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.network.neutron [None req-d24d9c33-9637-4ce4-9728-bee74b741a03 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] validate_networks() for [('143ca51d-04c4-49d1-b023-9392fa41c485', None, None, None, None, None)] {{(pid=118319) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 16:11:28.350073 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-3dee5938-52a7-4548-83b6-242b5aed53f2 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:28.357705 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-3dee5938-52a7-4548-83b6-242b5aed53f2 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1370 microversion: 2.1 time: 0.228247 Jul 05 16:11:28.358373 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 173/354] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:28 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1370 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:28.363841 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-33aa0457-d6c7-48f0-ba10-36aa62016d68 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:28.364906 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-33aa0457-d6c7-48f0-ba10-36aa62016d68 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:28.371286 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-33aa0457-d6c7-48f0-ba10-36aa62016d68 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:28.371658 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-33aa0457-d6c7-48f0-ba10-36aa62016d68 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:28.372466 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-33aa0457-d6c7-48f0-ba10-36aa62016d68 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:28.373112 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-33aa0457-d6c7-48f0-ba10-36aa62016d68 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:28.599016 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-33aa0457-d6c7-48f0-ba10-36aa62016d68 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:28.607395 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-33aa0457-d6c7-48f0-ba10-36aa62016d68 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:28.609068 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-33aa0457-d6c7-48f0-ba10-36aa62016d68 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:28.610567 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-33aa0457-d6c7-48f0-ba10-36aa62016d68 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1743 microversion: 2.20 time: 0.251280 Jul 05 16:11:28.611209 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 174/355] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:28 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1743 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:11:28.661439 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-f60f148e-9bdb-42cd-bec8-eb2a84c2f0df tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:28.662350 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-f60f148e-9bdb-42cd-bec8-eb2a84c2f0df tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 82eccf63-469a-47ea-aab4-536d6210c066] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:28.668668 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f60f148e-9bdb-42cd-bec8-eb2a84c2f0df tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:28.669221 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f60f148e-9bdb-42cd-bec8-eb2a84c2f0df tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:28.670065 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f60f148e-9bdb-42cd-bec8-eb2a84c2f0df tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:28.670575 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f60f148e-9bdb-42cd-bec8-eb2a84c2f0df tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:28.705575 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-d24d9c33-9637-4ce4-9728-bee74b741a03 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Flavor limits 0:0:0 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 16:11:28.706037 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-d24d9c33-9637-4ce4-9728-bee74b741a03 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Image limits 0:0:0 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 16:11:28.706538 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-d24d9c33-9637-4ce4-9728-bee74b741a03 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Flavor pref 0:0:0 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 16:11:28.706964 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-d24d9c33-9637-4ce4-9728-bee74b741a03 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Image pref 0:0:0 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 16:11:28.707539 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-d24d9c33-9637-4ce4-9728-bee74b741a03 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 16:11:28.716375 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d24d9c33-9637-4ce4-9728-bee74b741a03 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:28.716847 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d24d9c33-9637-4ce4-9728-bee74b741a03 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:28.717652 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d24d9c33-9637-4ce4-9728-bee74b741a03 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:28.718082 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d24d9c33-9637-4ce4-9728-bee74b741a03 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:28.735287 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.quota [None req-d24d9c33-9637-4ce4-9728-bee74b741a03 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Getting quotas for project dce6460ca0714dc98df6e69034242a7f. Resources: {'ram', 'instances', 'cores'} {{(pid=118319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:11:28.739466 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.quota [None req-d24d9c33-9637-4ce4-9728-bee74b741a03 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Getting quotas for user 6e0cc3e3c4804237b78241cca28ca689 and project dce6460ca0714dc98df6e69034242a7f. Resources: {'ram', 'instances', 'cores'} {{(pid=118319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:11:28.751532 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-d24d9c33-9637-4ce4-9728-bee74b741a03 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Going to run 1 instances... {{(pid=118319) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 16:11:28.753695 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-d24d9c33-9637-4ce4-9728-bee74b741a03 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 3a76848e-1c4b-494e-9160-6bdb585e27cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5805086-2ebd-4742-8185-f79894fef91e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 16:11:28.811702 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-f60f148e-9bdb-42cd-bec8-eb2a84c2f0df tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:28.819425 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-f60f148e-9bdb-42cd-bec8-eb2a84c2f0df tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066" status: 200 len: 1367 microversion: 2.1 time: 0.162325 Jul 05 16:11:28.820003 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 175/356] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:28 2022] GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:11:28.860664 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-d24d9c33-9637-4ce4-9728-bee74b741a03 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.676206 Jul 05 16:11:28.866243 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 182/357] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Jul 5 16:11:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 05 16:11:28.871868 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-36b73de5-4acb-4711-9efc-e65134600b08 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:28.872506 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-36b73de5-4acb-4711-9efc-e65134600b08 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 3a76848e-1c4b-494e-9160-6bdb585e27cc] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:28.924410 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-36b73de5-4acb-4711-9efc-e65134600b08 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:28.931750 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-36b73de5-4acb-4711-9efc-e65134600b08 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc" status: 200 len: 1214 microversion: 2.1 time: 0.063674 Jul 05 16:11:28.932311 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 176/358] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:28 2022] GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:29.099152 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-4d52539a-5585-4402-8f36-b944533c2ae8 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:29.099777 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-4d52539a-5585-4402-8f36-b944533c2ae8 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:29.106670 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-4d52539a-5585-4402-8f36-b944533c2ae8 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:29.107126 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-4d52539a-5585-4402-8f36-b944533c2ae8 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:29.107879 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-4d52539a-5585-4402-8f36-b944533c2ae8 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:29.108322 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-4d52539a-5585-4402-8f36-b944533c2ae8 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:29.251146 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-4d52539a-5585-4402-8f36-b944533c2ae8 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:29.259442 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-4d52539a-5585-4402-8f36-b944533c2ae8 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1721 microversion: 2.1 time: 0.164815 Jul 05 16:11:29.263466 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 183/359] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:29 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:29.302292 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-92b3b7b1-760c-4512-b207-24ce02fea218 req-e7ee17e4-1800-4041-8286-dbc0819c57ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82eccf63-469a-47ea-aab4-536d6210c066", "name": "network-vif-plugged", "status": "completed", "tag": "54f02c5c-3943-4041-9d1e-31e3fcfcdf17"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:11:29.315604 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-92b3b7b1-760c-4512-b207-24ce02fea218 req-e7ee17e4-1800-4041-8286-dbc0819c57ed service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:29.315604 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-92b3b7b1-760c-4512-b207-24ce02fea218 req-e7ee17e4-1800-4041-8286-dbc0819c57ed service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:29.324097 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-92b3b7b1-760c-4512-b207-24ce02fea218 req-e7ee17e4-1800-4041-8286-dbc0819c57ed service nova] Creating event network-vif-plugged:54f02c5c-3943-4041-9d1e-31e3fcfcdf17 for instance 82eccf63-469a-47ea-aab4-536d6210c066 on hv-cinder-84875 Jul 05 16:11:29.330154 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-92b3b7b1-760c-4512-b207-24ce02fea218 req-e7ee17e4-1800-4041-8286-dbc0819c57ed service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031492 Jul 05 16:11:29.331276 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 177/360] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:11:29.374805 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-429a9fe5-fdee-4a2d-bb48-e9d39df79121 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:29.375419 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-429a9fe5-fdee-4a2d-bb48-e9d39df79121 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:29.382339 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-429a9fe5-fdee-4a2d-bb48-e9d39df79121 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:29.383133 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-429a9fe5-fdee-4a2d-bb48-e9d39df79121 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:29.384163 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-429a9fe5-fdee-4a2d-bb48-e9d39df79121 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:29.384935 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-429a9fe5-fdee-4a2d-bb48-e9d39df79121 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:29.556138 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-429a9fe5-fdee-4a2d-bb48-e9d39df79121 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:29.563653 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-429a9fe5-fdee-4a2d-bb48-e9d39df79121 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1370 microversion: 2.1 time: 0.192807 Jul 05 16:11:29.564290 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 184/361] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:29 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1370 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:29.635160 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-19050695-1771-44b6-a54e-64aa54ba6a98 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:29.635900 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-19050695-1771-44b6-a54e-64aa54ba6a98 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:29.642233 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-19050695-1771-44b6-a54e-64aa54ba6a98 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:29.642693 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-19050695-1771-44b6-a54e-64aa54ba6a98 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:29.643466 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-19050695-1771-44b6-a54e-64aa54ba6a98 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:29.643914 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-19050695-1771-44b6-a54e-64aa54ba6a98 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:29.791887 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-19050695-1771-44b6-a54e-64aa54ba6a98 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:29.794247 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=100 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:11:29.800944 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-19050695-1771-44b6-a54e-64aa54ba6a98 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:29.802552 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-19050695-1771-44b6-a54e-64aa54ba6a98 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:29.803779 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-19050695-1771-44b6-a54e-64aa54ba6a98 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1743 microversion: 2.20 time: 0.173536 Jul 05 16:11:29.804469 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 178/362] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:29 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:11:29.836760 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-356c8d44-206d-491a-9634-1fb8bdce8ee7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:29.837405 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-356c8d44-206d-491a-9634-1fb8bdce8ee7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 82eccf63-469a-47ea-aab4-536d6210c066] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:29.844051 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-356c8d44-206d-491a-9634-1fb8bdce8ee7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:29.844545 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-356c8d44-206d-491a-9634-1fb8bdce8ee7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:29.845396 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-356c8d44-206d-491a-9634-1fb8bdce8ee7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:29.845826 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-356c8d44-206d-491a-9634-1fb8bdce8ee7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:29.950066 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-8ec12a3d-96e7-4429-8a1b-7d7bf601d634 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:29.950740 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-8ec12a3d-96e7-4429-8a1b-7d7bf601d634 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 3a76848e-1c4b-494e-9160-6bdb585e27cc] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:29.998522 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-356c8d44-206d-491a-9634-1fb8bdce8ee7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:30.006286 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-356c8d44-206d-491a-9634-1fb8bdce8ee7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066" status: 200 len: 1367 microversion: 2.1 time: 0.174455 Jul 05 16:11:30.007954 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 185/363] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:29 2022] GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:30.018485 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-8ec12a3d-96e7-4429-8a1b-7d7bf601d634 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:30.025372 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-8ec12a3d-96e7-4429-8a1b-7d7bf601d634 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc" status: 200 len: 1214 microversion: 2.1 time: 0.079424 Jul 05 16:11:30.025931 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 179/364] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:29 2022] GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:11:30.276020 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-ecefa243-0dc7-463a-a7e4-d4048afb6d4d tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:30.276955 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-ecefa243-0dc7-463a-a7e4-d4048afb6d4d tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:30.284107 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ecefa243-0dc7-463a-a7e4-d4048afb6d4d tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:30.284551 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ecefa243-0dc7-463a-a7e4-d4048afb6d4d tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:30.285423 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ecefa243-0dc7-463a-a7e4-d4048afb6d4d tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:30.285854 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ecefa243-0dc7-463a-a7e4-d4048afb6d4d tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:30.418852 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-ecefa243-0dc7-463a-a7e4-d4048afb6d4d tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:30.427960 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-ecefa243-0dc7-463a-a7e4-d4048afb6d4d tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1721 microversion: 2.1 time: 0.156012 Jul 05 16:11:30.428539 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 186/365] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:30 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:30.580998 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-29258020-317e-4c8f-9e57-b962d85de16d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:30.581622 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-29258020-317e-4c8f-9e57-b962d85de16d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:30.588684 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-29258020-317e-4c8f-9e57-b962d85de16d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:30.589199 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-29258020-317e-4c8f-9e57-b962d85de16d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:30.589971 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-29258020-317e-4c8f-9e57-b962d85de16d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:30.590418 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-29258020-317e-4c8f-9e57-b962d85de16d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:30.730858 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-29258020-317e-4c8f-9e57-b962d85de16d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:30.738816 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-29258020-317e-4c8f-9e57-b962d85de16d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1563 microversion: 2.1 time: 0.161655 Jul 05 16:11:30.739496 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 180/366] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:30 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:30.759897 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-0a66f812-7a17-4bfb-8621-e48b23c2846b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:30.762332 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-0a66f812-7a17-4bfb-8621-e48b23c2846b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:30.767281 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0a66f812-7a17-4bfb-8621-e48b23c2846b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:30.767978 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0a66f812-7a17-4bfb-8621-e48b23c2846b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:30.769026 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0a66f812-7a17-4bfb-8621-e48b23c2846b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:30.769563 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0a66f812-7a17-4bfb-8621-e48b23c2846b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:30.822908 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-5d3eea35-6ba2-4cd0-bd77-2b0c1af63304 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:30.823836 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-5d3eea35-6ba2-4cd0-bd77-2b0c1af63304 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:30.832744 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5d3eea35-6ba2-4cd0-bd77-2b0c1af63304 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:30.833319 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5d3eea35-6ba2-4cd0-bd77-2b0c1af63304 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:30.834149 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5d3eea35-6ba2-4cd0-bd77-2b0c1af63304 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:30.834661 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5d3eea35-6ba2-4cd0-bd77-2b0c1af63304 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:30.849057 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-0a66f812-7a17-4bfb-8621-e48b23c2846b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093405 Jul 05 16:11:30.849057 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 187/367] 10.222.0.45 () {58 vars in 1274 bytes} [Tue Jul 5 16:11:30 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:11:31.024288 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-55ac557a-4b76-4618-8b72-48931f73b8af tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:31.024942 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-55ac557a-4b76-4618-8b72-48931f73b8af tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 82eccf63-469a-47ea-aab4-536d6210c066] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:31.033985 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-55ac557a-4b76-4618-8b72-48931f73b8af tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:31.034439 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-55ac557a-4b76-4618-8b72-48931f73b8af tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:31.035219 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-55ac557a-4b76-4618-8b72-48931f73b8af tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:31.037360 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-55ac557a-4b76-4618-8b72-48931f73b8af tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:31.460855 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-55ac557a-4b76-4618-8b72-48931f73b8af tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:31.466676 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-5d3eea35-6ba2-4cd0-bd77-2b0c1af63304 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:31.471365 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-55ac557a-4b76-4618-8b72-48931f73b8af tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066" status: 200 len: 1367 microversion: 2.1 time: 0.450929 Jul 05 16:11:31.480497 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-5d3eea35-6ba2-4cd0-bd77-2b0c1af63304 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:31.481937 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 188/368] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:31 2022] GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066 => generated 1367 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:11:31.487388 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-3120d3c9-6d67-4ba6-b55a-fafb5140ba2d tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:31.488008 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-3120d3c9-6d67-4ba6-b55a-fafb5140ba2d tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 3a76848e-1c4b-494e-9160-6bdb585e27cc] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:31.494472 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3120d3c9-6d67-4ba6-b55a-fafb5140ba2d tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:31.494995 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3120d3c9-6d67-4ba6-b55a-fafb5140ba2d tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:31.495799 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3120d3c9-6d67-4ba6-b55a-fafb5140ba2d tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:31.496410 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3120d3c9-6d67-4ba6-b55a-fafb5140ba2d tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:31.497772 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-5d3eea35-6ba2-4cd0-bd77-2b0c1af63304 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:31.498971 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-5d3eea35-6ba2-4cd0-bd77-2b0c1af63304 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1743 microversion: 2.20 time: 0.680770 Jul 05 16:11:31.510664 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 181/369] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:30 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1743 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:11:31.518143 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-bfb5a04f-677b-4dfb-8fc9-989be6ded6eb req-1987ae12-f46f-478d-870b-e38981a34521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da368d38-2642-49c3-b499-eb5a977cbd77", "name": "network-vif-plugged", "status": "completed", "tag": "c24636dc-9b24-45b5-a963-180931342e24"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:11:31.535584 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-bfb5a04f-677b-4dfb-8fc9-989be6ded6eb req-1987ae12-f46f-478d-870b-e38981a34521 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:31.537696 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-bfb5a04f-677b-4dfb-8fc9-989be6ded6eb req-1987ae12-f46f-478d-870b-e38981a34521 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:31.549922 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-bfb5a04f-677b-4dfb-8fc9-989be6ded6eb req-1987ae12-f46f-478d-870b-e38981a34521 service nova] Creating event network-vif-plugged:c24636dc-9b24-45b5-a963-180931342e24 for instance da368d38-2642-49c3-b499-eb5a977cbd77 on hv-cinder-84875 Jul 05 16:11:31.555578 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-bfb5a04f-677b-4dfb-8fc9-989be6ded6eb req-1987ae12-f46f-478d-870b-e38981a34521 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043149 Jul 05 16:11:31.556467 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 182/370] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:11:31.564105 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-9488f282-1d05-4dc3-b916-14fd9bf60e29 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:31.564105 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-9488f282-1d05-4dc3-b916-14fd9bf60e29 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:31.570098 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9488f282-1d05-4dc3-b916-14fd9bf60e29 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:31.570783 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9488f282-1d05-4dc3-b916-14fd9bf60e29 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:31.571573 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9488f282-1d05-4dc3-b916-14fd9bf60e29 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:31.572013 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9488f282-1d05-4dc3-b916-14fd9bf60e29 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:31.600366 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-3120d3c9-6d67-4ba6-b55a-fafb5140ba2d tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:31.610351 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-3120d3c9-6d67-4ba6-b55a-fafb5140ba2d tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc" status: 200 len: 1266 microversion: 2.1 time: 0.126975 Jul 05 16:11:31.612228 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 189/371] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:31 2022] GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc => generated 1266 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:31.783272 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-9488f282-1d05-4dc3-b916-14fd9bf60e29 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:31.813325 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-9488f282-1d05-4dc3-b916-14fd9bf60e29 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1721 microversion: 2.1 time: 0.255378 Jul 05 16:11:31.831198 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 183/372] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:31 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1721 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:32.488479 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-0b12488b-7696-4660-81ff-82634f9bc839 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:32.489128 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-0b12488b-7696-4660-81ff-82634f9bc839 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 82eccf63-469a-47ea-aab4-536d6210c066] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:32.499776 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0b12488b-7696-4660-81ff-82634f9bc839 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:32.500232 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0b12488b-7696-4660-81ff-82634f9bc839 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:32.501051 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0b12488b-7696-4660-81ff-82634f9bc839 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:32.501517 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0b12488b-7696-4660-81ff-82634f9bc839 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:32.517773 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-c08fdfec-a88e-433e-a5ef-964923c099e0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:32.522329 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-c08fdfec-a88e-433e-a5ef-964923c099e0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:32.524730 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c08fdfec-a88e-433e-a5ef-964923c099e0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:32.525215 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c08fdfec-a88e-433e-a5ef-964923c099e0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:32.525983 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c08fdfec-a88e-433e-a5ef-964923c099e0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:32.526417 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c08fdfec-a88e-433e-a5ef-964923c099e0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:32.847444 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-0b12488b-7696-4660-81ff-82634f9bc839 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:32.864723 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-0b12488b-7696-4660-81ff-82634f9bc839 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066" status: 200 len: 1557 microversion: 2.1 time: 0.380349 Jul 05 16:11:32.865749 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 190/373] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:32 2022] GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066 => generated 1557 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:32.871552 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-4560ed83-70c4-4cf6-8407-836f7587e1b0 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:32.872504 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-4560ed83-70c4-4cf6-8407-836f7587e1b0 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 3a76848e-1c4b-494e-9160-6bdb585e27cc] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:32.893622 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-4560ed83-70c4-4cf6-8407-836f7587e1b0 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:32.894993 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-4560ed83-70c4-4cf6-8407-836f7587e1b0 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:32.896061 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-4560ed83-70c4-4cf6-8407-836f7587e1b0 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:32.902803 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c08fdfec-a88e-433e-a5ef-964923c099e0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:32.904586 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-4560ed83-70c4-4cf6-8407-836f7587e1b0 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:32.929865 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c08fdfec-a88e-433e-a5ef-964923c099e0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:32.931948 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c08fdfec-a88e-433e-a5ef-964923c099e0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:32.937052 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-c08fdfec-a88e-433e-a5ef-964923c099e0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1738 microversion: 2.20 time: 0.419764 Jul 05 16:11:32.937987 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 184/374] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:32 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1738 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:11:32.947495 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-f27f2038-58b8-42e6-aeb5-ba51c5d90155 req-b8513db8-7f2e-465b-bcfa-c1036b6b471e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42be8657-fc50-4057-b373-e7bcf984e261", "tag": "81587e02-fcd0-4999-9ed7-aae4729b5548"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:11:32.958816 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-f27f2038-58b8-42e6-aeb5-ba51c5d90155 req-b8513db8-7f2e-465b-bcfa-c1036b6b471e service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:32.959262 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-f27f2038-58b8-42e6-aeb5-ba51c5d90155 req-b8513db8-7f2e-465b-bcfa-c1036b6b471e service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:32.982796 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-f27f2038-58b8-42e6-aeb5-ba51c5d90155 req-b8513db8-7f2e-465b-bcfa-c1036b6b471e service nova] Creating event network-changed:81587e02-fcd0-4999-9ed7-aae4729b5548 for instance 42be8657-fc50-4057-b373-e7bcf984e261 on hv-cinder-84875 Jul 05 16:11:32.990591 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-f27f2038-58b8-42e6-aeb5-ba51c5d90155 req-b8513db8-7f2e-465b-bcfa-c1036b6b471e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050376 Jul 05 16:11:32.993232 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 185/375] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:11:33.005227 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-5200d882-2767-47a8-a646-bd0f290e704f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:33.006113 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-5200d882-2767-47a8-a646-bd0f290e704f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:33.007998 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-4560ed83-70c4-4cf6-8407-836f7587e1b0 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:33.016546 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5200d882-2767-47a8-a646-bd0f290e704f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:33.022113 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-4560ed83-70c4-4cf6-8407-836f7587e1b0 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc" status: 200 len: 1272 microversion: 2.1 time: 0.149529 Jul 05 16:11:33.022312 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5200d882-2767-47a8-a646-bd0f290e704f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:33.022452 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 191/376] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:32 2022] GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc => generated 1272 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:33.022585 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5200d882-2767-47a8-a646-bd0f290e704f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:33.022585 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5200d882-2767-47a8-a646-bd0f290e704f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:33.023394 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-543f5b90-f915-43c1-ae2e-8ca2847e7c7d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:33.024393 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-543f5b90-f915-43c1-ae2e-8ca2847e7c7d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 82eccf63-469a-47ea-aab4-536d6210c066] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:33.031571 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-543f5b90-f915-43c1-ae2e-8ca2847e7c7d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:33.032334 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-543f5b90-f915-43c1-ae2e-8ca2847e7c7d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:33.033314 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-543f5b90-f915-43c1-ae2e-8ca2847e7c7d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:33.033968 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-543f5b90-f915-43c1-ae2e-8ca2847e7c7d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:33.208636 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-543f5b90-f915-43c1-ae2e-8ca2847e7c7d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.189798 Jul 05 16:11:33.209532 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 192/377] 10.222.0.45 () {58 vars in 1274 bytes} [Tue Jul 5 16:11:33 2022] GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066/os-interface => generated 284 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:11:33.947260 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-5200d882-2767-47a8-a646-bd0f290e704f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:33.955819 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-5200d882-2767-47a8-a646-bd0f290e704f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1721 microversion: 2.1 time: 0.962594 Jul 05 16:11:33.956416 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 186/378] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:32 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1721 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:33.963903 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-3bf443c5-f0d9-46a8-b3e3-fe3c3af8039f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:33.964690 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-3bf443c5-f0d9-46a8-b3e3-fe3c3af8039f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:33.981435 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3bf443c5-f0d9-46a8-b3e3-fe3c3af8039f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:33.984836 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3bf443c5-f0d9-46a8-b3e3-fe3c3af8039f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:33.988371 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3bf443c5-f0d9-46a8-b3e3-fe3c3af8039f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:33.991311 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3bf443c5-f0d9-46a8-b3e3-fe3c3af8039f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:34.035761 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-0f2990ee-423d-4841-84be-03cdcdcc1594 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:34.039029 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-0f2990ee-423d-4841-84be-03cdcdcc1594 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 3a76848e-1c4b-494e-9160-6bdb585e27cc] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:34.045281 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0f2990ee-423d-4841-84be-03cdcdcc1594 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:34.045762 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0f2990ee-423d-4841-84be-03cdcdcc1594 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:34.050324 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0f2990ee-423d-4841-84be-03cdcdcc1594 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:34.051143 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0f2990ee-423d-4841-84be-03cdcdcc1594 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:34.542610 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-3bf443c5-f0d9-46a8-b3e3-fe3c3af8039f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:34.553381 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-3bf443c5-f0d9-46a8-b3e3-fe3c3af8039f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:34.560514 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-3bf443c5-f0d9-46a8-b3e3-fe3c3af8039f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:34.561786 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-3bf443c5-f0d9-46a8-b3e3-fe3c3af8039f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1738 microversion: 2.20 time: 0.609696 Jul 05 16:11:34.562364 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 193/379] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:33 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1738 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:11:34.654764 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-0f2990ee-423d-4841-84be-03cdcdcc1594 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:34.665778 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-0f2990ee-423d-4841-84be-03cdcdcc1594 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc" status: 200 len: 1314 microversion: 2.1 time: 0.633746 Jul 05 16:11:34.681495 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 187/380] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:34 2022] GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc => generated 1314 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:11:34.985756 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-0ae50255-4c79-4618-9fdb-6f0fa90de232 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:34.986379 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-0ae50255-4c79-4618-9fdb-6f0fa90de232 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:35.014207 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0ae50255-4c79-4618-9fdb-6f0fa90de232 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:35.014207 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0ae50255-4c79-4618-9fdb-6f0fa90de232 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:35.014207 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0ae50255-4c79-4618-9fdb-6f0fa90de232 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:35.014207 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0ae50255-4c79-4618-9fdb-6f0fa90de232 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:35.076650 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-370ca486-220e-401d-9104-c5bcebfeeca1 req-d30f5d52-a414-4d91-8039-241da16f363c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82eccf63-469a-47ea-aab4-536d6210c066", "tag": "54f02c5c-3943-4041-9d1e-31e3fcfcdf17"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:11:35.101775 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-370ca486-220e-401d-9104-c5bcebfeeca1 req-d30f5d52-a414-4d91-8039-241da16f363c service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:35.102900 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-370ca486-220e-401d-9104-c5bcebfeeca1 req-d30f5d52-a414-4d91-8039-241da16f363c service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:35.136086 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-370ca486-220e-401d-9104-c5bcebfeeca1 req-d30f5d52-a414-4d91-8039-241da16f363c service nova] Creating event network-changed:54f02c5c-3943-4041-9d1e-31e3fcfcdf17 for instance 82eccf63-469a-47ea-aab4-536d6210c066 on hv-cinder-84875 Jul 05 16:11:35.155055 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-370ca486-220e-401d-9104-c5bcebfeeca1 req-d30f5d52-a414-4d91-8039-241da16f363c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081556 Jul 05 16:11:35.160781 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 188/381] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:11:35.532079 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-0ae50255-4c79-4618-9fdb-6f0fa90de232 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:35.543301 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-0ae50255-4c79-4618-9fdb-6f0fa90de232 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1721 microversion: 2.1 time: 0.569954 Jul 05 16:11:35.555357 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 194/382] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:34 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1721 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:35.583576 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-3ccc02a1-0c7a-4f63-b182-1b13aea7ce51 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:35.584686 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-3ccc02a1-0c7a-4f63-b182-1b13aea7ce51 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:35.603127 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3ccc02a1-0c7a-4f63-b182-1b13aea7ce51 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:35.614496 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3ccc02a1-0c7a-4f63-b182-1b13aea7ce51 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:35.618977 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3ccc02a1-0c7a-4f63-b182-1b13aea7ce51 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:35.620222 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3ccc02a1-0c7a-4f63-b182-1b13aea7ce51 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:35.696351 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-cd7bcf4d-757e-436a-82c1-34aefb7112f9 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:35.698758 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-cd7bcf4d-757e-436a-82c1-34aefb7112f9 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 3a76848e-1c4b-494e-9160-6bdb585e27cc] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:35.716347 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cd7bcf4d-757e-436a-82c1-34aefb7112f9 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:35.719101 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cd7bcf4d-757e-436a-82c1-34aefb7112f9 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:35.720338 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cd7bcf4d-757e-436a-82c1-34aefb7112f9 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:35.721073 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cd7bcf4d-757e-436a-82c1-34aefb7112f9 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:35.956504 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-3ccc02a1-0c7a-4f63-b182-1b13aea7ce51 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:35.973431 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-3ccc02a1-0c7a-4f63-b182-1b13aea7ce51 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:35.981925 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-3ccc02a1-0c7a-4f63-b182-1b13aea7ce51 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:35.983497 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-3ccc02a1-0c7a-4f63-b182-1b13aea7ce51 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1738 microversion: 2.20 time: 0.407091 Jul 05 16:11:35.987457 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 189/383] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:35 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1738 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:11:36.043627 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-cd7bcf4d-757e-436a-82c1-34aefb7112f9 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:36.057361 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-cd7bcf4d-757e-436a-82c1-34aefb7112f9 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc" status: 200 len: 1314 microversion: 2.1 time: 0.372509 Jul 05 16:11:36.081984 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 195/384] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:35 2022] GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:36.564440 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-5ddca4e6-d5f0-45f8-9a6a-ea668b581832 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:36.565264 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-5ddca4e6-d5f0-45f8-9a6a-ea668b581832 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:36.574613 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5ddca4e6-d5f0-45f8-9a6a-ea668b581832 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:36.575207 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5ddca4e6-d5f0-45f8-9a6a-ea668b581832 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:36.576561 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5ddca4e6-d5f0-45f8-9a6a-ea668b581832 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:36.577174 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5ddca4e6-d5f0-45f8-9a6a-ea668b581832 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:36.674029 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [req-c03078ae-18cd-4d33-9ba4-68b70454d021 req-63534482-abb0-4989-bca4-258f7ee81a6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a76848e-1c4b-494e-9160-6bdb585e27cc", "tag": "2d45c376-9580-4310-a232-3fc6e8714d05"}]} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:11:36.689342 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-c03078ae-18cd-4d33-9ba4-68b70454d021 req-63534482-abb0-4989-bca4-258f7ee81a6c service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:36.691274 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-c03078ae-18cd-4d33-9ba4-68b70454d021 req-63534482-abb0-4989-bca4-258f7ee81a6c service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:36.710157 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.compute.server_external_events [req-c03078ae-18cd-4d33-9ba4-68b70454d021 req-63534482-abb0-4989-bca4-258f7ee81a6c service nova] Creating event network-changed:2d45c376-9580-4310-a232-3fc6e8714d05 for instance 3a76848e-1c4b-494e-9160-6bdb585e27cc on hv-cinder-84875 Jul 05 16:11:36.716716 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [req-c03078ae-18cd-4d33-9ba4-68b70454d021 req-63534482-abb0-4989-bca4-258f7ee81a6c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048335 Jul 05 16:11:36.717959 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 196/385] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:11:36.881475 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-5ddca4e6-d5f0-45f8-9a6a-ea668b581832 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:36.890439 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-5ddca4e6-d5f0-45f8-9a6a-ea668b581832 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1698 microversion: 2.1 time: 0.329839 Jul 05 16:11:36.900483 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 190/386] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:36 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1698 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:36.922668 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-dd8325d4-109b-465f-839e-657d5a53e754 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:11:36.934475 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-dd8325d4-109b-465f-839e-657d5a53e754 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:36.934929 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-dd8325d4-109b-465f-839e-657d5a53e754 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:37.011457 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-ebd82f30-07f7-40bf-9034-dc5ea847b835 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:37.012680 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-ebd82f30-07f7-40bf-9034-dc5ea847b835 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:37.026789 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ebd82f30-07f7-40bf-9034-dc5ea847b835 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:37.027291 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ebd82f30-07f7-40bf-9034-dc5ea847b835 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:37.028079 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ebd82f30-07f7-40bf-9034-dc5ea847b835 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:37.028657 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ebd82f30-07f7-40bf-9034-dc5ea847b835 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:37.096744 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-dd8325d4-109b-465f-839e-657d5a53e754 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Going to try to start instance {{(pid=118319) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 05 16:11:37.146682 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell1:SELECT=100 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:11:37.298361 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-dd8325d4-109b-465f-839e-657d5a53e754 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "POST /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74/action" status: 202 len: 0 microversion: 2.1 time: 0.380331 Jul 05 16:11:37.300546 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 197/387] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Jul 5 16:11:36 2022] POST /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 16:11:37.313088 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-ebd82f30-07f7-40bf-9034-dc5ea847b835 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:37.314498 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-9d880525-e6f3-472b-bef9-f677840e29ea tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:37.315683 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-9d880525-e6f3-472b-bef9-f677840e29ea tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 3a76848e-1c4b-494e-9160-6bdb585e27cc] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:37.328238 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9d880525-e6f3-472b-bef9-f677840e29ea tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:37.332926 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9d880525-e6f3-472b-bef9-f677840e29ea tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:37.332926 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9d880525-e6f3-472b-bef9-f677840e29ea tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:37.332926 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9d880525-e6f3-472b-bef9-f677840e29ea tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:37.333602 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-ebd82f30-07f7-40bf-9034-dc5ea847b835 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:37.338025 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-ebd82f30-07f7-40bf-9034-dc5ea847b835 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:37.347256 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-ebd82f30-07f7-40bf-9034-dc5ea847b835 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1738 microversion: 2.20 time: 0.339078 Jul 05 16:11:37.349013 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 191/388] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:37 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1738 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:11:37.354916 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-6c845d2b-9c05-4bf6-8e42-4707a77ec4d7 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:37.355911 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-6c845d2b-9c05-4bf6-8e42-4707a77ec4d7 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:37.363268 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6c845d2b-9c05-4bf6-8e42-4707a77ec4d7 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:37.364193 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6c845d2b-9c05-4bf6-8e42-4707a77ec4d7 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:37.369970 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6c845d2b-9c05-4bf6-8e42-4707a77ec4d7 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:37.370539 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6c845d2b-9c05-4bf6-8e42-4707a77ec4d7 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:37.721250 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-9d880525-e6f3-472b-bef9-f677840e29ea tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:37.731010 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-9d880525-e6f3-472b-bef9-f677840e29ea tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc" status: 200 len: 1314 microversion: 2.1 time: 0.426871 Jul 05 16:11:37.736571 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 198/389] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:37 2022] GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:37.779377 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-6c845d2b-9c05-4bf6-8e42-4707a77ec4d7 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:37.791279 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-6c845d2b-9c05-4bf6-8e42-4707a77ec4d7 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1707 microversion: 2.1 time: 0.440673 Jul 05 16:11:37.792228 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 192/390] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:37 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1707 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:38.372128 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-68e656d3-acf9-4aee-b274-f3d2dd2d197b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:38.372798 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-68e656d3-acf9-4aee-b274-f3d2dd2d197b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:38.379353 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-68e656d3-acf9-4aee-b274-f3d2dd2d197b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:38.383084 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-68e656d3-acf9-4aee-b274-f3d2dd2d197b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:38.383084 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-68e656d3-acf9-4aee-b274-f3d2dd2d197b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:38.383084 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-68e656d3-acf9-4aee-b274-f3d2dd2d197b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:38.535863 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-68e656d3-acf9-4aee-b274-f3d2dd2d197b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:38.544992 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-68e656d3-acf9-4aee-b274-f3d2dd2d197b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:38.546493 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-68e656d3-acf9-4aee-b274-f3d2dd2d197b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:38.547926 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-68e656d3-acf9-4aee-b274-f3d2dd2d197b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1738 microversion: 2.20 time: 0.179584 Jul 05 16:11:38.548487 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 199/391] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:38 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:11:38.752617 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-2b713e66-05ab-4b55-9c1b-45c42da59d07 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:38.753260 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-2b713e66-05ab-4b55-9c1b-45c42da59d07 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 3a76848e-1c4b-494e-9160-6bdb585e27cc] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:38.759782 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2b713e66-05ab-4b55-9c1b-45c42da59d07 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:38.760232 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2b713e66-05ab-4b55-9c1b-45c42da59d07 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:38.761027 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2b713e66-05ab-4b55-9c1b-45c42da59d07 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:38.761468 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2b713e66-05ab-4b55-9c1b-45c42da59d07 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:38.809916 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-b76166c7-6e07-44e9-a700-567071d5d4db tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:38.810623 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-b76166c7-6e07-44e9-a700-567071d5d4db tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:38.812646 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell0:SELECT=2 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:11:38.813425 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell0:SELECT=6 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:11:38.818472 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b76166c7-6e07-44e9-a700-567071d5d4db tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:38.824922 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b76166c7-6e07-44e9-a700-567071d5d4db tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:38.824922 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b76166c7-6e07-44e9-a700-567071d5d4db tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:38.824922 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b76166c7-6e07-44e9-a700-567071d5d4db tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:38.934829 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-2b713e66-05ab-4b55-9c1b-45c42da59d07 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:38.942616 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-2b713e66-05ab-4b55-9c1b-45c42da59d07 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc" status: 200 len: 1314 microversion: 2.1 time: 0.193782 Jul 05 16:11:38.943198 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 193/392] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:38 2022] GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:38.978044 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-b76166c7-6e07-44e9-a700-567071d5d4db tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:38.987510 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-b76166c7-6e07-44e9-a700-567071d5d4db tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1707 microversion: 2.1 time: 0.181456 Jul 05 16:11:38.991135 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 200/393] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:38 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1707 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:39.567116 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-93471a60-e417-4355-b7d4-225543d148ba tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:39.567727 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-93471a60-e417-4355-b7d4-225543d148ba tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:39.574882 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-93471a60-e417-4355-b7d4-225543d148ba tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:39.575344 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-93471a60-e417-4355-b7d4-225543d148ba tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:39.576108 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-93471a60-e417-4355-b7d4-225543d148ba tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:39.576542 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-93471a60-e417-4355-b7d4-225543d148ba tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:39.711724 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-93471a60-e417-4355-b7d4-225543d148ba tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:39.715995 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-93471a60-e417-4355-b7d4-225543d148ba tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:39.717549 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-93471a60-e417-4355-b7d4-225543d148ba tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:39.718750 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-93471a60-e417-4355-b7d4-225543d148ba tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1738 microversion: 2.20 time: 0.156065 Jul 05 16:11:39.719317 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 194/394] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:39 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:11:39.963486 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-fa37f67c-da22-430e-8c60-5727b9e13e2a tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:39.966091 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-fa37f67c-da22-430e-8c60-5727b9e13e2a tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 3a76848e-1c4b-494e-9160-6bdb585e27cc] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:39.977197 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fa37f67c-da22-430e-8c60-5727b9e13e2a tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:39.977650 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fa37f67c-da22-430e-8c60-5727b9e13e2a tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:39.978439 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fa37f67c-da22-430e-8c60-5727b9e13e2a tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:39.978873 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fa37f67c-da22-430e-8c60-5727b9e13e2a tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:40.006867 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-f9268c3b-cc40-4c37-abb1-ed308a4a46c9 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:40.008169 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-f9268c3b-cc40-4c37-abb1-ed308a4a46c9 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:40.019903 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f9268c3b-cc40-4c37-abb1-ed308a4a46c9 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:40.020694 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f9268c3b-cc40-4c37-abb1-ed308a4a46c9 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:40.021864 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f9268c3b-cc40-4c37-abb1-ed308a4a46c9 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:40.022380 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f9268c3b-cc40-4c37-abb1-ed308a4a46c9 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:40.023753 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell0:SELECT=4 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:11:40.206738 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-fa37f67c-da22-430e-8c60-5727b9e13e2a tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:40.221580 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-fa37f67c-da22-430e-8c60-5727b9e13e2a tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc" status: 200 len: 1314 microversion: 2.1 time: 0.263711 Jul 05 16:11:40.237163 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 201/395] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:39 2022] GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:40.265910 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-f9268c3b-cc40-4c37-abb1-ed308a4a46c9 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:40.274302 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-f9268c3b-cc40-4c37-abb1-ed308a4a46c9 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1707 microversion: 2.1 time: 0.271871 Jul 05 16:11:40.274875 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 195/396] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:40 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1707 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:40.737822 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-31c72013-be9c-4a1a-b45b-7dbf5e6c1bf4 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:40.738853 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-31c72013-be9c-4a1a-b45b-7dbf5e6c1bf4 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:40.740841 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:11:40.746553 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-31c72013-be9c-4a1a-b45b-7dbf5e6c1bf4 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:40.747117 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-31c72013-be9c-4a1a-b45b-7dbf5e6c1bf4 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:40.748031 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-31c72013-be9c-4a1a-b45b-7dbf5e6c1bf4 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:40.748973 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-31c72013-be9c-4a1a-b45b-7dbf5e6c1bf4 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:40.905030 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-31c72013-be9c-4a1a-b45b-7dbf5e6c1bf4 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:40.913399 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-31c72013-be9c-4a1a-b45b-7dbf5e6c1bf4 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:40.916002 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-31c72013-be9c-4a1a-b45b-7dbf5e6c1bf4 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:40.917150 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-31c72013-be9c-4a1a-b45b-7dbf5e6c1bf4 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1738 microversion: 2.20 time: 0.184096 Jul 05 16:11:40.917882 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 202/397] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:40 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:11:41.243412 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-e747c797-c44a-4eda-8295-21a0562e2c34 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:41.244973 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-e747c797-c44a-4eda-8295-21a0562e2c34 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 3a76848e-1c4b-494e-9160-6bdb585e27cc] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:41.259060 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e747c797-c44a-4eda-8295-21a0562e2c34 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:41.261159 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e747c797-c44a-4eda-8295-21a0562e2c34 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:41.262139 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e747c797-c44a-4eda-8295-21a0562e2c34 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:41.263826 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e747c797-c44a-4eda-8295-21a0562e2c34 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:41.292393 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-b42294c3-fd23-41de-ae68-08d3b4604e25 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:41.293199 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-b42294c3-fd23-41de-ae68-08d3b4604e25 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:41.307015 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b42294c3-fd23-41de-ae68-08d3b4604e25 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:41.308209 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b42294c3-fd23-41de-ae68-08d3b4604e25 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:41.309135 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b42294c3-fd23-41de-ae68-08d3b4604e25 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:41.310135 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b42294c3-fd23-41de-ae68-08d3b4604e25 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:41.571082 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-b42294c3-fd23-41de-ae68-08d3b4604e25 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:41.579133 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-b42294c3-fd23-41de-ae68-08d3b4604e25 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1711 microversion: 2.1 time: 0.291417 Jul 05 16:11:41.580024 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 203/398] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:41 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1711 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:11:41.581116 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-e747c797-c44a-4eda-8295-21a0562e2c34 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:41.589597 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-e747c797-c44a-4eda-8295-21a0562e2c34 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc" status: 200 len: 1314 microversion: 2.1 time: 0.352612 Jul 05 16:11:41.599522 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 196/399] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:41 2022] GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:41.938358 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-10b22df2-722c-4668-9462-432ebd2f1852 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:41.938962 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-10b22df2-722c-4668-9462-432ebd2f1852 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:41.945101 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-10b22df2-722c-4668-9462-432ebd2f1852 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:41.945577 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-10b22df2-722c-4668-9462-432ebd2f1852 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:41.946304 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-10b22df2-722c-4668-9462-432ebd2f1852 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:41.946746 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-10b22df2-722c-4668-9462-432ebd2f1852 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:42.109172 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-10b22df2-722c-4668-9462-432ebd2f1852 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:42.117487 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-10b22df2-722c-4668-9462-432ebd2f1852 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:42.119079 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-10b22df2-722c-4668-9462-432ebd2f1852 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:42.120269 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-10b22df2-722c-4668-9462-432ebd2f1852 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1738 microversion: 2.20 time: 0.186982 Jul 05 16:11:42.120861 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 204/400] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:41 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:11:42.606957 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-1acb2208-5051-4e1d-85a6-7710be3a39b8 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:42.607528 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-1acb2208-5051-4e1d-85a6-7710be3a39b8 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 3a76848e-1c4b-494e-9160-6bdb585e27cc] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:42.614409 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1acb2208-5051-4e1d-85a6-7710be3a39b8 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:42.614880 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1acb2208-5051-4e1d-85a6-7710be3a39b8 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:42.615639 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1acb2208-5051-4e1d-85a6-7710be3a39b8 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:42.616104 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1acb2208-5051-4e1d-85a6-7710be3a39b8 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:42.745576 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-1acb2208-5051-4e1d-85a6-7710be3a39b8 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:42.752913 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-1acb2208-5051-4e1d-85a6-7710be3a39b8 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc" status: 200 len: 1314 microversion: 2.1 time: 0.149998 Jul 05 16:11:42.753472 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 197/401] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:42 2022] GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:43.139577 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-9e0c1940-57c7-481d-bfd7-6e2de62f3757 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:43.140200 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-9e0c1940-57c7-481d-bfd7-6e2de62f3757 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:43.146777 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9e0c1940-57c7-481d-bfd7-6e2de62f3757 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:43.148071 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9e0c1940-57c7-481d-bfd7-6e2de62f3757 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:43.149154 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9e0c1940-57c7-481d-bfd7-6e2de62f3757 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:43.149780 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9e0c1940-57c7-481d-bfd7-6e2de62f3757 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:43.302592 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-9e0c1940-57c7-481d-bfd7-6e2de62f3757 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:43.312406 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-9e0c1940-57c7-481d-bfd7-6e2de62f3757 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:43.314112 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-9e0c1940-57c7-481d-bfd7-6e2de62f3757 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:43.316225 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-9e0c1940-57c7-481d-bfd7-6e2de62f3757 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1738 microversion: 2.20 time: 0.180406 Jul 05 16:11:43.317520 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 205/402] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:43 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:11:43.403667 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-bb6ff71c-2f9a-42d6-bdb7-66ecbe0b1dfc req-8f572d36-b1a2-41bb-b5e4-6e7d0231e7f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a76848e-1c4b-494e-9160-6bdb585e27cc", "name": "network-vif-plugged", "status": "completed", "tag": "2d45c376-9580-4310-a232-3fc6e8714d05"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:11:43.417985 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-bb6ff71c-2f9a-42d6-bdb7-66ecbe0b1dfc req-8f572d36-b1a2-41bb-b5e4-6e7d0231e7f0 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:43.418563 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-bb6ff71c-2f9a-42d6-bdb7-66ecbe0b1dfc req-8f572d36-b1a2-41bb-b5e4-6e7d0231e7f0 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:43.431949 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-bb6ff71c-2f9a-42d6-bdb7-66ecbe0b1dfc req-8f572d36-b1a2-41bb-b5e4-6e7d0231e7f0 service nova] Creating event network-vif-plugged:2d45c376-9580-4310-a232-3fc6e8714d05 for instance 3a76848e-1c4b-494e-9160-6bdb585e27cc on hv-cinder-84875 Jul 05 16:11:43.437628 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-bb6ff71c-2f9a-42d6-bdb7-66ecbe0b1dfc req-8f572d36-b1a2-41bb-b5e4-6e7d0231e7f0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038203 Jul 05 16:11:43.441669 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 198/403] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:11:43.770571 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-c59164ef-b463-4529-bd48-735c84ef351e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:43.771595 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-c59164ef-b463-4529-bd48-735c84ef351e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 3a76848e-1c4b-494e-9160-6bdb585e27cc] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:43.780330 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c59164ef-b463-4529-bd48-735c84ef351e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:43.781337 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c59164ef-b463-4529-bd48-735c84ef351e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:43.782130 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c59164ef-b463-4529-bd48-735c84ef351e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:43.782566 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c59164ef-b463-4529-bd48-735c84ef351e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:43.943790 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-c59164ef-b463-4529-bd48-735c84ef351e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:43.952216 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-c59164ef-b463-4529-bd48-735c84ef351e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc" status: 200 len: 1314 microversion: 2.1 time: 0.185828 Jul 05 16:11:43.961150 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 206/404] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:43 2022] GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:44.336790 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-06fdd26e-2a33-4bf0-b114-603a9431ad0c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:44.337492 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-06fdd26e-2a33-4bf0-b114-603a9431ad0c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:44.349637 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-06fdd26e-2a33-4bf0-b114-603a9431ad0c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:44.350100 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-06fdd26e-2a33-4bf0-b114-603a9431ad0c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:44.351757 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-06fdd26e-2a33-4bf0-b114-603a9431ad0c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:44.352406 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-06fdd26e-2a33-4bf0-b114-603a9431ad0c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:44.356190 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=100 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:11:44.513022 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-06fdd26e-2a33-4bf0-b114-603a9431ad0c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:44.521676 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-06fdd26e-2a33-4bf0-b114-603a9431ad0c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:44.523342 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-06fdd26e-2a33-4bf0-b114-603a9431ad0c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:44.527907 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-06fdd26e-2a33-4bf0-b114-603a9431ad0c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1738 microversion: 2.20 time: 0.192763 Jul 05 16:11:44.527907 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 199/405] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:44 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:11:44.969602 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-d5737c2f-f39f-418b-99d0-0c4fc1bcc8ec tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:44.970348 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-d5737c2f-f39f-418b-99d0-0c4fc1bcc8ec tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 3a76848e-1c4b-494e-9160-6bdb585e27cc] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:44.977737 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d5737c2f-f39f-418b-99d0-0c4fc1bcc8ec tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:44.978188 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d5737c2f-f39f-418b-99d0-0c4fc1bcc8ec tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:44.979732 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d5737c2f-f39f-418b-99d0-0c4fc1bcc8ec tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:44.979732 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d5737c2f-f39f-418b-99d0-0c4fc1bcc8ec tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:45.124024 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-d5737c2f-f39f-418b-99d0-0c4fc1bcc8ec tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:45.131889 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-d5737c2f-f39f-418b-99d0-0c4fc1bcc8ec tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc" status: 200 len: 1314 microversion: 2.1 time: 0.166623 Jul 05 16:11:45.132817 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 207/406] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:44 2022] GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:45.543457 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-272af543-e119-4861-91b4-5eefc7e31f76 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:45.544257 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-272af543-e119-4861-91b4-5eefc7e31f76 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:45.551292 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-272af543-e119-4861-91b4-5eefc7e31f76 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:45.551711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-272af543-e119-4861-91b4-5eefc7e31f76 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:45.552549 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-272af543-e119-4861-91b4-5eefc7e31f76 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:45.553021 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-272af543-e119-4861-91b4-5eefc7e31f76 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:45.735763 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-272af543-e119-4861-91b4-5eefc7e31f76 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:45.744725 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-272af543-e119-4861-91b4-5eefc7e31f76 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:45.747260 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-272af543-e119-4861-91b4-5eefc7e31f76 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:45.748720 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-272af543-e119-4861-91b4-5eefc7e31f76 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1738 microversion: 2.20 time: 0.209477 Jul 05 16:11:45.749387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 200/407] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:45 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1738 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:11:46.153591 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-f6e65a6a-62fe-4ad1-af88-7b1d7f0ab43c tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:46.153591 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-f6e65a6a-62fe-4ad1-af88-7b1d7f0ab43c tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 3a76848e-1c4b-494e-9160-6bdb585e27cc] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:46.155587 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f6e65a6a-62fe-4ad1-af88-7b1d7f0ab43c tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:46.156029 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f6e65a6a-62fe-4ad1-af88-7b1d7f0ab43c tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:46.156817 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f6e65a6a-62fe-4ad1-af88-7b1d7f0ab43c tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:46.157571 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f6e65a6a-62fe-4ad1-af88-7b1d7f0ab43c tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:46.282955 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-f6e65a6a-62fe-4ad1-af88-7b1d7f0ab43c tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:46.290824 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-f6e65a6a-62fe-4ad1-af88-7b1d7f0ab43c tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc" status: 200 len: 1314 microversion: 2.1 time: 0.146107 Jul 05 16:11:46.291391 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 208/408] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:46 2022] GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:46.769124 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-456a49d3-dd3b-4572-8bbf-1aaab3c2156b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:46.770386 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-456a49d3-dd3b-4572-8bbf-1aaab3c2156b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:46.777401 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-456a49d3-dd3b-4572-8bbf-1aaab3c2156b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:46.778063 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-456a49d3-dd3b-4572-8bbf-1aaab3c2156b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:46.779014 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-456a49d3-dd3b-4572-8bbf-1aaab3c2156b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:46.779601 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-456a49d3-dd3b-4572-8bbf-1aaab3c2156b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:46.936043 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-456a49d3-dd3b-4572-8bbf-1aaab3c2156b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:46.948864 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-456a49d3-dd3b-4572-8bbf-1aaab3c2156b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:46.950865 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-456a49d3-dd3b-4572-8bbf-1aaab3c2156b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:46.952409 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-456a49d3-dd3b-4572-8bbf-1aaab3c2156b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1738 microversion: 2.20 time: 0.188629 Jul 05 16:11:46.953407 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 201/409] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:46 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:11:47.308347 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-e236b4b3-f6a3-49fd-bdde-957006505533 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:47.309004 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-e236b4b3-f6a3-49fd-bdde-957006505533 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 3a76848e-1c4b-494e-9160-6bdb585e27cc] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:47.318789 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e236b4b3-f6a3-49fd-bdde-957006505533 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:47.319233 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e236b4b3-f6a3-49fd-bdde-957006505533 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:47.319992 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e236b4b3-f6a3-49fd-bdde-957006505533 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:47.321012 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e236b4b3-f6a3-49fd-bdde-957006505533 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:47.459418 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-e236b4b3-f6a3-49fd-bdde-957006505533 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:47.467504 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-e236b4b3-f6a3-49fd-bdde-957006505533 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc" status: 200 len: 1497 microversion: 2.1 time: 0.163844 Jul 05 16:11:47.477420 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 209/410] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:47 2022] GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:47.971208 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-c9906a89-2d0e-490a-bdfe-022ac2c252e8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:47.971981 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-c9906a89-2d0e-490a-bdfe-022ac2c252e8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:47.975321 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_api:SELECT=98 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:11:47.979587 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c9906a89-2d0e-490a-bdfe-022ac2c252e8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:47.980107 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c9906a89-2d0e-490a-bdfe-022ac2c252e8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:47.980917 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c9906a89-2d0e-490a-bdfe-022ac2c252e8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:47.981367 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c9906a89-2d0e-490a-bdfe-022ac2c252e8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:48.133686 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c9906a89-2d0e-490a-bdfe-022ac2c252e8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:48.141746 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c9906a89-2d0e-490a-bdfe-022ac2c252e8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:48.143261 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c9906a89-2d0e-490a-bdfe-022ac2c252e8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:48.144414 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-c9906a89-2d0e-490a-bdfe-022ac2c252e8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1738 microversion: 2.20 time: 0.177048 Jul 05 16:11:48.145352 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 202/411] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:47 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:11:48.354915 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-52fa3397-ea8e-4bca-afa3-9ed28421b09a tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:48.355510 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-52fa3397-ea8e-4bca-afa3-9ed28421b09a tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 3a76848e-1c4b-494e-9160-6bdb585e27cc] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:48.362429 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-52fa3397-ea8e-4bca-afa3-9ed28421b09a tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:48.362879 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-52fa3397-ea8e-4bca-afa3-9ed28421b09a tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:48.363636 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-52fa3397-ea8e-4bca-afa3-9ed28421b09a tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:48.364071 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-52fa3397-ea8e-4bca-afa3-9ed28421b09a tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:48.389849 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-52fa3397-ea8e-4bca-afa3-9ed28421b09a tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 3a76848e-1c4b-494e-9160-6bdb585e27cc] Going to try to terminate instance {{(pid=118319) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 16:11:48.658918 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-52fa3397-ea8e-4bca-afa3-9ed28421b09a tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc" status: 204 len: 0 microversion: 2.1 time: 0.307882 Jul 05 16:11:48.663327 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 210/412] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Jul 5 16:11:48 2022] DELETE /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 16:11:48.668834 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-79a6e18d-1aed-47c6-959e-656b03637cfa tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:48.669458 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-79a6e18d-1aed-47c6-959e-656b03637cfa tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 3a76848e-1c4b-494e-9160-6bdb585e27cc] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:48.680467 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-79a6e18d-1aed-47c6-959e-656b03637cfa tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:48.684475 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-79a6e18d-1aed-47c6-959e-656b03637cfa tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:48.684475 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-79a6e18d-1aed-47c6-959e-656b03637cfa tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:48.684475 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-79a6e18d-1aed-47c6-959e-656b03637cfa tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:48.822730 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-79a6e18d-1aed-47c6-959e-656b03637cfa tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:48.828408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-79a6e18d-1aed-47c6-959e-656b03637cfa tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc" status: 200 len: 1503 microversion: 2.1 time: 0.164027 Jul 05 16:11:48.829321 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 203/413] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:48 2022] GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:49.164839 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-3ccc7e8d-d42d-4652-a760-7b470edbcc90 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:49.165548 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-3ccc7e8d-d42d-4652-a760-7b470edbcc90 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:49.172400 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3ccc7e8d-d42d-4652-a760-7b470edbcc90 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:49.173120 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3ccc7e8d-d42d-4652-a760-7b470edbcc90 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:49.174326 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3ccc7e8d-d42d-4652-a760-7b470edbcc90 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:49.174848 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3ccc7e8d-d42d-4652-a760-7b470edbcc90 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:49.311698 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-3ccc7e8d-d42d-4652-a760-7b470edbcc90 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:49.319529 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-3ccc7e8d-d42d-4652-a760-7b470edbcc90 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:49.321069 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-3ccc7e8d-d42d-4652-a760-7b470edbcc90 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:49.326627 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-3ccc7e8d-d42d-4652-a760-7b470edbcc90 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1720 microversion: 2.20 time: 0.162990 Jul 05 16:11:49.326627 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 211/414] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:49 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:11:49.846248 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-9d2190f8-0369-481e-a1fa-79b701845670 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:49.846916 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-9d2190f8-0369-481e-a1fa-79b701845670 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 3a76848e-1c4b-494e-9160-6bdb585e27cc] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:49.853131 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9d2190f8-0369-481e-a1fa-79b701845670 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:49.853578 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9d2190f8-0369-481e-a1fa-79b701845670 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:49.854338 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9d2190f8-0369-481e-a1fa-79b701845670 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:49.854773 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9d2190f8-0369-481e-a1fa-79b701845670 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:49.985108 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-9d2190f8-0369-481e-a1fa-79b701845670 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:49.993137 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-9d2190f8-0369-481e-a1fa-79b701845670 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc" status: 200 len: 1503 microversion: 2.1 time: 0.151180 Jul 05 16:11:49.993955 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 204/415] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:49 2022] GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:50.340607 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-4fa6dfcd-ae4c-4ac2-b854-3c46c39e319c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:50.341238 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-4fa6dfcd-ae4c-4ac2-b854-3c46c39e319c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:50.347716 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-4fa6dfcd-ae4c-4ac2-b854-3c46c39e319c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:50.348160 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-4fa6dfcd-ae4c-4ac2-b854-3c46c39e319c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:50.348961 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-4fa6dfcd-ae4c-4ac2-b854-3c46c39e319c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:50.349399 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-4fa6dfcd-ae4c-4ac2-b854-3c46c39e319c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:50.353425 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:11:50.476160 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-4fa6dfcd-ae4c-4ac2-b854-3c46c39e319c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:50.485429 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-4fa6dfcd-ae4c-4ac2-b854-3c46c39e319c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:50.487006 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-4fa6dfcd-ae4c-4ac2-b854-3c46c39e319c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:50.488299 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-4fa6dfcd-ae4c-4ac2-b854-3c46c39e319c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1720 microversion: 2.20 time: 0.151507 Jul 05 16:11:50.488813 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 212/416] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:50 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:11:51.010390 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-c87cf547-4dd8-4844-898b-266d19df4ba2 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:51.010922 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-c87cf547-4dd8-4844-898b-266d19df4ba2 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 3a76848e-1c4b-494e-9160-6bdb585e27cc] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:51.018986 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c87cf547-4dd8-4844-898b-266d19df4ba2 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:51.018986 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c87cf547-4dd8-4844-898b-266d19df4ba2 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:51.018986 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c87cf547-4dd8-4844-898b-266d19df4ba2 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:51.019249 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c87cf547-4dd8-4844-898b-266d19df4ba2 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:51.250751 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [req-02978093-de05-460c-b265-94fff23fcb2c req-3902b209-c824-41fb-9c62-ff4cb7df2a39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da368d38-2642-49c3-b499-eb5a977cbd77", "name": "network-vif-unplugged", "status": "completed", "tag": "c24636dc-9b24-45b5-a963-180931342e24"}]} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:11:51.261781 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-02978093-de05-460c-b265-94fff23fcb2c req-3902b209-c824-41fb-9c62-ff4cb7df2a39 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:51.262206 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-02978093-de05-460c-b265-94fff23fcb2c req-3902b209-c824-41fb-9c62-ff4cb7df2a39 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:51.293933 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.compute.server_external_events [req-02978093-de05-460c-b265-94fff23fcb2c req-3902b209-c824-41fb-9c62-ff4cb7df2a39 service nova] Creating event network-vif-unplugged:c24636dc-9b24-45b5-a963-180931342e24 for instance da368d38-2642-49c3-b499-eb5a977cbd77 on hv-cinder-84875 Jul 05 16:11:51.300005 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [req-02978093-de05-460c-b265-94fff23fcb2c req-3902b209-c824-41fb-9c62-ff4cb7df2a39 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052723 Jul 05 16:11:51.300607 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 213/417] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:11:51.385255 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c87cf547-4dd8-4844-898b-266d19df4ba2 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:51.392794 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-c87cf547-4dd8-4844-898b-266d19df4ba2 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc" status: 200 len: 1503 microversion: 2.1 time: 0.386481 Jul 05 16:11:51.393369 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 205/418] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:51 2022] GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc => generated 1503 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:51.507477 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-28fb2dc5-899d-4e64-a2f6-50a05c2a0830 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:51.508884 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-28fb2dc5-899d-4e64-a2f6-50a05c2a0830 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:51.515813 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-28fb2dc5-899d-4e64-a2f6-50a05c2a0830 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:51.516202 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-28fb2dc5-899d-4e64-a2f6-50a05c2a0830 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:51.516982 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-28fb2dc5-899d-4e64-a2f6-50a05c2a0830 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:51.517416 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-28fb2dc5-899d-4e64-a2f6-50a05c2a0830 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:51.646053 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-28fb2dc5-899d-4e64-a2f6-50a05c2a0830 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:51.654337 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-28fb2dc5-899d-4e64-a2f6-50a05c2a0830 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:51.655903 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-28fb2dc5-899d-4e64-a2f6-50a05c2a0830 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:51.657073 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-28fb2dc5-899d-4e64-a2f6-50a05c2a0830 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1720 microversion: 2.20 time: 0.154211 Jul 05 16:11:51.657924 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 214/419] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:51 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:11:52.411839 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-2f358ffd-1b31-4bdb-9ca1-9d701e96e803 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:52.412259 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-2f358ffd-1b31-4bdb-9ca1-9d701e96e803 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 3a76848e-1c4b-494e-9160-6bdb585e27cc] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:52.419579 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2f358ffd-1b31-4bdb-9ca1-9d701e96e803 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:52.420097 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2f358ffd-1b31-4bdb-9ca1-9d701e96e803 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:52.420884 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2f358ffd-1b31-4bdb-9ca1-9d701e96e803 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:52.421323 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2f358ffd-1b31-4bdb-9ca1-9d701e96e803 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:52.602484 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-2f358ffd-1b31-4bdb-9ca1-9d701e96e803 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:52.605957 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [req-928401d5-2c64-49d5-8253-a6a906faeb50 req-d62339b2-ca8a-49ec-a1db-a4d2ab02f7b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a76848e-1c4b-494e-9160-6bdb585e27cc", "name": "network-vif-deleted", "tag": "2d45c376-9580-4310-a232-3fc6e8714d05"}]} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:11:52.613010 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-2f358ffd-1b31-4bdb-9ca1-9d701e96e803 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc" status: 200 len: 1503 microversion: 2.1 time: 0.205856 Jul 05 16:11:52.617173 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 206/420] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:52 2022] GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc => generated 1503 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:52.617348 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-928401d5-2c64-49d5-8253-a6a906faeb50 req-d62339b2-ca8a-49ec-a1db-a4d2ab02f7b2 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:52.617812 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-928401d5-2c64-49d5-8253-a6a906faeb50 req-d62339b2-ca8a-49ec-a1db-a4d2ab02f7b2 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:52.629143 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.compute.server_external_events [req-928401d5-2c64-49d5-8253-a6a906faeb50 req-d62339b2-ca8a-49ec-a1db-a4d2ab02f7b2 service nova] Creating event network-vif-deleted:2d45c376-9580-4310-a232-3fc6e8714d05 for instance 3a76848e-1c4b-494e-9160-6bdb585e27cc on hv-cinder-84875 Jul 05 16:11:52.634264 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [req-928401d5-2c64-49d5-8253-a6a906faeb50 req-d62339b2-ca8a-49ec-a1db-a4d2ab02f7b2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037604 Jul 05 16:11:52.634888 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 215/421] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:11:52.675972 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-71e5bba7-00ec-4f08-909d-8f387f559911 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:52.676619 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-71e5bba7-00ec-4f08-909d-8f387f559911 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:52.682579 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-71e5bba7-00ec-4f08-909d-8f387f559911 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:52.683021 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-71e5bba7-00ec-4f08-909d-8f387f559911 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:52.683779 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-71e5bba7-00ec-4f08-909d-8f387f559911 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:52.684216 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-71e5bba7-00ec-4f08-909d-8f387f559911 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:52.842852 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-71e5bba7-00ec-4f08-909d-8f387f559911 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:52.848151 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-71e5bba7-00ec-4f08-909d-8f387f559911 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:52.849714 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-71e5bba7-00ec-4f08-909d-8f387f559911 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:52.850880 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-71e5bba7-00ec-4f08-909d-8f387f559911 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1723 microversion: 2.20 time: 0.179357 Jul 05 16:11:52.851501 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 207/422] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:52 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:11:52.869655 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-090c8e81-83c3-4693-8b57-e7180fff9d4d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db049fae-81b1-4db4-b615-e280848f36a7"}} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:11:52.870811 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-090c8e81-83c3-4693-8b57-e7180fff9d4d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:52.876981 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-090c8e81-83c3-4693-8b57-e7180fff9d4d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:52.877433 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-090c8e81-83c3-4693-8b57-e7180fff9d4d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:52.878205 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-090c8e81-83c3-4693-8b57-e7180fff9d4d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:52.878643 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-090c8e81-83c3-4693-8b57-e7180fff9d4d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:53.629971 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-6a27632a-65a6-4247-aca7-43a24bc822bf tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:53.630611 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-6a27632a-65a6-4247-aca7-43a24bc822bf tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 3a76848e-1c4b-494e-9160-6bdb585e27cc] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:53.637378 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6a27632a-65a6-4247-aca7-43a24bc822bf tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:53.637835 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6a27632a-65a6-4247-aca7-43a24bc822bf tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:53.638614 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6a27632a-65a6-4247-aca7-43a24bc822bf tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:53.639058 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6a27632a-65a6-4247-aca7-43a24bc822bf tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:53.670461 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6a27632a-65a6-4247-aca7-43a24bc822bf tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:53.670914 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6a27632a-65a6-4247-aca7-43a24bc822bf tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:53.671364 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.objects.instance [None req-6a27632a-65a6-4247-aca7-43a24bc822bf tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lazy-loading 'fault' on Instance uuid 3a76848e-1c4b-494e-9160-6bdb585e27cc {{(pid=118320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 16:11:53.723595 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-6a27632a-65a6-4247-aca7-43a24bc822bf tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:53.733130 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-6a27632a-65a6-4247-aca7-43a24bc822bf tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc" status: 200 len: 1304 microversion: 2.1 time: 0.106873 Jul 05 16:11:53.736416 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 208/423] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:53 2022] GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:11:54.008470 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-090c8e81-83c3-4693-8b57-e7180fff9d4d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "POST /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.143141 Jul 05 16:11:54.009433 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 216/424] 10.222.0.45 () {62 vars in 1363 bytes} [Tue Jul 5 16:11:52 2022] POST /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77/os-volume_attachments => generated 188 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 16:11:54.135298 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-ec788f6c-36a1-4f20-864d-e70a8d758d87 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:11:54.135863 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-ec788f6c-36a1-4f20-864d-e70a8d758d87 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:54.142091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ec788f6c-36a1-4f20-864d-e70a8d758d87 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:54.142556 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ec788f6c-36a1-4f20-864d-e70a8d758d87 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:54.143300 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ec788f6c-36a1-4f20-864d-e70a8d758d87 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:54.143734 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ec788f6c-36a1-4f20-864d-e70a8d758d87 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:54.362439 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-ec788f6c-36a1-4f20-864d-e70a8d758d87 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "POST /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77/action" status: 202 len: 0 microversion: 2.20 time: 0.231040 Jul 05 16:11:54.363056 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 209/425] 10.222.0.45 () {62 vars in 1318 bytes} [Tue Jul 5 16:11:54 2022] POST /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 05 16:11:54.371354 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-b052a90f-ddbd-4b35-8409-ddfa1c45d46f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:54.372207 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-b052a90f-ddbd-4b35-8409-ddfa1c45d46f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:54.381317 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b052a90f-ddbd-4b35-8409-ddfa1c45d46f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:54.381974 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b052a90f-ddbd-4b35-8409-ddfa1c45d46f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:54.383847 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b052a90f-ddbd-4b35-8409-ddfa1c45d46f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:54.392299 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b052a90f-ddbd-4b35-8409-ddfa1c45d46f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:54.527314 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-b052a90f-ddbd-4b35-8409-ddfa1c45d46f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:54.537512 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-b052a90f-ddbd-4b35-8409-ddfa1c45d46f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:54.539570 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-b052a90f-ddbd-4b35-8409-ddfa1c45d46f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:54.541465 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-b052a90f-ddbd-4b35-8409-ddfa1c45d46f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1749 microversion: 2.20 time: 0.174287 Jul 05 16:11:54.542038 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 217/426] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:54 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1749 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:11:54.752713 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-17bdad40-11a6-4544-b061-9187b939459e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:54.753614 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-17bdad40-11a6-4544-b061-9187b939459e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 3a76848e-1c4b-494e-9160-6bdb585e27cc] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:54.761068 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-17bdad40-11a6-4544-b061-9187b939459e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:54.761528 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-17bdad40-11a6-4544-b061-9187b939459e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:54.762304 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-17bdad40-11a6-4544-b061-9187b939459e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:54.762744 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-17bdad40-11a6-4544-b061-9187b939459e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:54.778534 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-17bdad40-11a6-4544-b061-9187b939459e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] HTTP exception thrown: Instance 3a76848e-1c4b-494e-9160-6bdb585e27cc could not be found. Jul 05 16:11:54.780171 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-17bdad40-11a6-4544-b061-9187b939459e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Request method failure captured: Jul 05 16:11:54.780171 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc HTTP/1.1 Jul 05 16:11:54.780171 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:11:54.780171 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:11:54.780171 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:11:54.780171 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:11:54.780171 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:11:54.780171 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:11:54.780171 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:11:54.780171 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:11:54.780171 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGKtcdGsrX_tLennRdFCsIcZM1nr6h96BYRutHstnAOyu27fv29jQarkNO8C-3yQIlKS72lqumZAJeVUGgWJ7mQLv2C94X10a9mJLtcCIy4iP9vZaiKH3Y-fsM-VGYE2UFVHDRA--9r6Lzyqs3VtVyp0n7CLIO8GFx5JTrKFqPLwutk Jul 05 16:11:54.780171 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:11:54.780171 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:11:54.780171 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:11:54.780171 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:11:54.780171 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:11:54.780171 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:11:54.780171 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: dce6460ca0714dc98df6e69034242a7f Jul 05 16:11:54.780171 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-VolumesActionsTest-1910468147 Jul 05 16:11:54.780171 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:11:54.780171 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:11:54.781622 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_dce6460ca0714dc98df6e69034242a7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/dce6460ca0714dc98df6e69034242a7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/dce6460ca0714dc98df6e69034242a7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/dce6460ca0714dc98df6e69034242a7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:11:54.781622 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-VolumesActionsTest-1910468147 Jul 05 16:11:54.781622 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: dce6460ca0714dc98df6e69034242a7f Jul 05 16:11:54.781622 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-VolumesActionsTest-1910468147 Jul 05 16:11:54.781622 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-VolumesActionsTest-1910468147-project Jul 05 16:11:54.781622 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:11:54.781622 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:11:54.781622 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: 6e0cc3e3c4804237b78241cca28ca689 Jul 05 16:11:54.781622 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-VolumesActionsTest-1910468147-project Jul 05 16:11:54.781622 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:11:54.781622 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance 3a76848e-1c4b-494e-9160-6bdb585e27cc could not be found. Jul 05 16:11:54.781622 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': '3a76848e-1c4b-494e-9160-6bdb585e27cc'} Jul 05 16:11:54.782382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:11:54.782382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:11:54.782382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:11:54.782382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:11:54.782382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:11:54.782382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:11:54.782382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:11:54.782382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:11:54.782382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:11:54.782382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:11:54.782382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a76848e-1c4b-494e-9160-6bdb585e27cc could not be found. Jul 05 16:11:54.782382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:11:54.782382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:11:54.782382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:11:54.782382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:11:54.782382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:11:54.782382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:11:54.782382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:11:54.782382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:11:54.782382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:11:54.783579 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:11:54.783579 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 16:11:54.783579 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 16:11:54.783579 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:11:54.783579 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:11:54.783579 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:11:54.783579 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:11:54.783579 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a76848e-1c4b-494e-9160-6bdb585e27cc could not be found. Jul 05 16:11:54.783579 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:11:54.783579 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:11:54.783579 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:11:54.783579 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:11:54.783579 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:11:54.783579 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:11:54.783579 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:11:54.783579 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:11:54.783579 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a76848e-1c4b-494e-9160-6bdb585e27cc could not be found. Jul 05 16:11:54.783579 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:11:54.784643 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-17bdad40-11a6-4544-b061-9187b939459e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Returning 404 to user: Instance 3a76848e-1c4b-494e-9160-6bdb585e27cc could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:11:54.784643 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-17bdad40-11a6-4544-b061-9187b939459e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc" status: 404 len: 111 microversion: 2.1 time: 0.034422 Jul 05 16:11:54.784643 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 210/427] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:54 2022] GET /compute/v2.1/servers/3a76848e-1c4b-494e-9160-6bdb585e27cc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 16:11:54.896416 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-fd813663-bdaf-425d-9c9d-50f8922aba84 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1103910883", "imageRef": "c5805086-2ebd-4742-8185-f79894fef91e", "flavorRef": "452", "networks": [{"uuid": "143ca51d-04c4-49d1-b023-9392fa41c485"}]}} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:11:54.957153 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.network.neutron [None req-fd813663-bdaf-425d-9c9d-50f8922aba84 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] validate_networks() for [('143ca51d-04c4-49d1-b023-9392fa41c485', None, None, None, None, None)] {{(pid=118319) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 16:11:55.379643 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-fd813663-bdaf-425d-9c9d-50f8922aba84 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Flavor limits 0:0:0 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 16:11:55.380212 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-fd813663-bdaf-425d-9c9d-50f8922aba84 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Image limits 0:0:0 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 16:11:55.380513 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-fd813663-bdaf-425d-9c9d-50f8922aba84 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Flavor pref 0:0:0 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 16:11:55.380949 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-fd813663-bdaf-425d-9c9d-50f8922aba84 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Image pref 0:0:0 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 16:11:55.381585 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-fd813663-bdaf-425d-9c9d-50f8922aba84 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 16:11:55.395182 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fd813663-bdaf-425d-9c9d-50f8922aba84 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:55.396917 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fd813663-bdaf-425d-9c9d-50f8922aba84 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:55.396917 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fd813663-bdaf-425d-9c9d-50f8922aba84 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:55.397268 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fd813663-bdaf-425d-9c9d-50f8922aba84 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:55.415049 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.quota [None req-fd813663-bdaf-425d-9c9d-50f8922aba84 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Getting quotas for project dce6460ca0714dc98df6e69034242a7f. Resources: {'ram', 'instances', 'cores'} {{(pid=118319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:11:55.419237 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.quota [None req-fd813663-bdaf-425d-9c9d-50f8922aba84 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Getting quotas for user 6e0cc3e3c4804237b78241cca28ca689 and project dce6460ca0714dc98df6e69034242a7f. Resources: {'ram', 'instances', 'cores'} {{(pid=118319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:11:55.430344 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-fd813663-bdaf-425d-9c9d-50f8922aba84 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Going to run 1 instances... {{(pid=118319) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 16:11:55.432614 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-fd813663-bdaf-425d-9c9d-50f8922aba84 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 352bc2a1-37ac-4578-8931-9ccb50d45e55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5805086-2ebd-4742-8185-f79894fef91e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 16:11:55.561239 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-9ff5f373-d3dd-4a8b-9fac-79e69c913702 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:55.562317 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-9ff5f373-d3dd-4a8b-9fac-79e69c913702 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:55.570336 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9ff5f373-d3dd-4a8b-9fac-79e69c913702 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:55.570903 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9ff5f373-d3dd-4a8b-9fac-79e69c913702 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:55.572293 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9ff5f373-d3dd-4a8b-9fac-79e69c913702 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:55.573159 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9ff5f373-d3dd-4a8b-9fac-79e69c913702 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:55.589114 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-fd813663-bdaf-425d-9c9d-50f8922aba84 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.696339 Jul 05 16:11:55.589905 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 218/428] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Jul 5 16:11:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 16:11:55.605299 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-65fad9be-fb14-4c22-a2c7-2bf9f289e85a tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:55.605910 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-65fad9be-fb14-4c22-a2c7-2bf9f289e85a tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 352bc2a1-37ac-4578-8931-9ccb50d45e55] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:55.691024 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-65fad9be-fb14-4c22-a2c7-2bf9f289e85a tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:55.701848 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-65fad9be-fb14-4c22-a2c7-2bf9f289e85a tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55" status: 200 len: 1214 microversion: 2.1 time: 0.101887 Jul 05 16:11:55.702634 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 219/429] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:55 2022] GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55 => generated 1214 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:55.774550 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-9ff5f373-d3dd-4a8b-9fac-79e69c913702 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:55.785338 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-9ff5f373-d3dd-4a8b-9fac-79e69c913702 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:55.787388 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-9ff5f373-d3dd-4a8b-9fac-79e69c913702 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:55.789048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-9ff5f373-d3dd-4a8b-9fac-79e69c913702 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1749 microversion: 2.20 time: 0.233058 Jul 05 16:11:55.789815 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 211/430] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:55 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1749 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:11:56.718910 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-c557e0cf-4eb2-4a30-8253-a1b3614dd9b3 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:56.719558 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-c557e0cf-4eb2-4a30-8253-a1b3614dd9b3 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 352bc2a1-37ac-4578-8931-9ccb50d45e55] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:56.726571 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c557e0cf-4eb2-4a30-8253-a1b3614dd9b3 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:56.727094 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c557e0cf-4eb2-4a30-8253-a1b3614dd9b3 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:56.727867 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c557e0cf-4eb2-4a30-8253-a1b3614dd9b3 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:56.728303 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c557e0cf-4eb2-4a30-8253-a1b3614dd9b3 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:56.801140 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-c557e0cf-4eb2-4a30-8253-a1b3614dd9b3 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:56.807533 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-7e8794a4-6bf2-4f3e-88c2-83a004c23b8a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:56.808262 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-7e8794a4-6bf2-4f3e-88c2-83a004c23b8a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:56.808604 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-c557e0cf-4eb2-4a30-8253-a1b3614dd9b3 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55" status: 200 len: 1218 microversion: 2.1 time: 0.093626 Jul 05 16:11:56.809195 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 220/431] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:56 2022] GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:56.815223 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7e8794a4-6bf2-4f3e-88c2-83a004c23b8a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:56.815672 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7e8794a4-6bf2-4f3e-88c2-83a004c23b8a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:56.816442 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7e8794a4-6bf2-4f3e-88c2-83a004c23b8a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:56.816916 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7e8794a4-6bf2-4f3e-88c2-83a004c23b8a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:56.950687 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-7e8794a4-6bf2-4f3e-88c2-83a004c23b8a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:56.959337 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-7e8794a4-6bf2-4f3e-88c2-83a004c23b8a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:56.961192 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-7e8794a4-6bf2-4f3e-88c2-83a004c23b8a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:56.962493 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-7e8794a4-6bf2-4f3e-88c2-83a004c23b8a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1751 microversion: 2.20 time: 0.158903 Jul 05 16:11:56.963061 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 212/432] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:56 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:11:57.826412 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-635c2af8-cfe7-46d7-8cf8-7cd54c346b54 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:57.827094 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-635c2af8-cfe7-46d7-8cf8-7cd54c346b54 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 352bc2a1-37ac-4578-8931-9ccb50d45e55] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:57.833626 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-635c2af8-cfe7-46d7-8cf8-7cd54c346b54 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:57.834126 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-635c2af8-cfe7-46d7-8cf8-7cd54c346b54 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:57.834892 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-635c2af8-cfe7-46d7-8cf8-7cd54c346b54 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:57.835331 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-635c2af8-cfe7-46d7-8cf8-7cd54c346b54 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:57.899638 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-635c2af8-cfe7-46d7-8cf8-7cd54c346b54 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:57.908025 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-635c2af8-cfe7-46d7-8cf8-7cd54c346b54 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55" status: 200 len: 1274 microversion: 2.1 time: 0.085525 Jul 05 16:11:57.908627 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 221/433] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:57 2022] GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55 => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:57.982648 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-21a384c6-c1f4-4a4f-8719-c66a989cdc95 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:57.983611 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-21a384c6-c1f4-4a4f-8719-c66a989cdc95 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:57.999549 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-21a384c6-c1f4-4a4f-8719-c66a989cdc95 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:58.000105 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-21a384c6-c1f4-4a4f-8719-c66a989cdc95 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:58.001004 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-21a384c6-c1f4-4a4f-8719-c66a989cdc95 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:58.001510 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-21a384c6-c1f4-4a4f-8719-c66a989cdc95 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:58.139838 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-21a384c6-c1f4-4a4f-8719-c66a989cdc95 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:58.148669 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-21a384c6-c1f4-4a4f-8719-c66a989cdc95 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:58.150245 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-21a384c6-c1f4-4a4f-8719-c66a989cdc95 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:58.151416 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-21a384c6-c1f4-4a4f-8719-c66a989cdc95 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1751 microversion: 2.20 time: 0.173588 Jul 05 16:11:58.151998 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 213/434] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:57 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:11:58.926530 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-1128065f-5e89-436e-8f33-d85d7960af44 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:58.927147 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-1128065f-5e89-436e-8f33-d85d7960af44 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 352bc2a1-37ac-4578-8931-9ccb50d45e55] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:58.933737 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1128065f-5e89-436e-8f33-d85d7960af44 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:58.934185 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1128065f-5e89-436e-8f33-d85d7960af44 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:58.934956 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1128065f-5e89-436e-8f33-d85d7960af44 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:58.935385 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1128065f-5e89-436e-8f33-d85d7960af44 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:59.173318 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-952528de-a2f6-4265-9650-fe40af9d6fab tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:11:59.173318 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-952528de-a2f6-4265-9650-fe40af9d6fab tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:11:59.177319 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-952528de-a2f6-4265-9650-fe40af9d6fab tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:59.177798 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-952528de-a2f6-4265-9650-fe40af9d6fab tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:59.178620 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-952528de-a2f6-4265-9650-fe40af9d6fab tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:59.179039 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-952528de-a2f6-4265-9650-fe40af9d6fab tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:59.294451 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-1128065f-5e89-436e-8f33-d85d7960af44 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:59.310677 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-1128065f-5e89-436e-8f33-d85d7960af44 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55" status: 200 len: 1314 microversion: 2.1 time: 0.387498 Jul 05 16:11:59.314851 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 222/435] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:11:58 2022] GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55 => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:11:59.336834 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [req-50a0aaad-a1b4-424d-8ec1-9672e44170db req-feb6cf16-3f66-49ba-81e0-a5ea072d1787 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "352bc2a1-37ac-4578-8931-9ccb50d45e55", "tag": "facb9c57-f5b3-48fc-91c3-b67f526ada63"}]} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:11:59.345601 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-50a0aaad-a1b4-424d-8ec1-9672e44170db req-feb6cf16-3f66-49ba-81e0-a5ea072d1787 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:11:59.346044 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-50a0aaad-a1b4-424d-8ec1-9672e44170db req-feb6cf16-3f66-49ba-81e0-a5ea072d1787 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:11:59.360978 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.compute.server_external_events [req-50a0aaad-a1b4-424d-8ec1-9672e44170db req-feb6cf16-3f66-49ba-81e0-a5ea072d1787 service nova] Creating event network-changed:facb9c57-f5b3-48fc-91c3-b67f526ada63 for instance 352bc2a1-37ac-4578-8931-9ccb50d45e55 on hv-cinder-84875 Jul 05 16:11:59.367289 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [req-50a0aaad-a1b4-424d-8ec1-9672e44170db req-feb6cf16-3f66-49ba-81e0-a5ea072d1787 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033467 Jul 05 16:11:59.368272 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 223/436] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:11:59.372228 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-952528de-a2f6-4265-9650-fe40af9d6fab tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:59.388871 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-952528de-a2f6-4265-9650-fe40af9d6fab tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:59.388871 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-952528de-a2f6-4265-9650-fe40af9d6fab tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:11:59.388871 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-952528de-a2f6-4265-9650-fe40af9d6fab tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1807 microversion: 2.20 time: 0.218886 Jul 05 16:11:59.389386 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 214/437] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:11:59 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1807 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:12:00.333514 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-fcaf5106-1bc1-4b53-a458-3cc862e1e79e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:00.334447 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-fcaf5106-1bc1-4b53-a458-3cc862e1e79e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 352bc2a1-37ac-4578-8931-9ccb50d45e55] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:00.342522 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fcaf5106-1bc1-4b53-a458-3cc862e1e79e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:00.342966 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fcaf5106-1bc1-4b53-a458-3cc862e1e79e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:00.343879 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fcaf5106-1bc1-4b53-a458-3cc862e1e79e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:00.344586 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fcaf5106-1bc1-4b53-a458-3cc862e1e79e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:00.403394 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-0a607fdb-d0cb-4ba3-ae7c-b9583689cfd5 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:00.404205 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-0a607fdb-d0cb-4ba3-ae7c-b9583689cfd5 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:00.411154 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0a607fdb-d0cb-4ba3-ae7c-b9583689cfd5 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:00.411610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0a607fdb-d0cb-4ba3-ae7c-b9583689cfd5 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:00.412399 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0a607fdb-d0cb-4ba3-ae7c-b9583689cfd5 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:00.412859 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0a607fdb-d0cb-4ba3-ae7c-b9583689cfd5 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:00.417344 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:00.538765 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-fcaf5106-1bc1-4b53-a458-3cc862e1e79e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:00.554338 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-fcaf5106-1bc1-4b53-a458-3cc862e1e79e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55" status: 200 len: 1314 microversion: 2.1 time: 0.220878 Jul 05 16:12:00.554338 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 224/438] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:00 2022] GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:00.621790 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-0a607fdb-d0cb-4ba3-ae7c-b9583689cfd5 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:00.642220 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-0a607fdb-d0cb-4ba3-ae7c-b9583689cfd5 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:00.643753 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-0a607fdb-d0cb-4ba3-ae7c-b9583689cfd5 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:00.646882 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-0a607fdb-d0cb-4ba3-ae7c-b9583689cfd5 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1807 microversion: 2.20 time: 0.247351 Jul 05 16:12:00.647486 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 215/439] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:12:00 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1807 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:12:01.567536 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-e6f5cc22-30b0-40a5-b5db-aa5e923e909e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:01.568387 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-e6f5cc22-30b0-40a5-b5db-aa5e923e909e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 352bc2a1-37ac-4578-8931-9ccb50d45e55] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:01.577405 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e6f5cc22-30b0-40a5-b5db-aa5e923e909e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:01.578089 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e6f5cc22-30b0-40a5-b5db-aa5e923e909e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:01.579204 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e6f5cc22-30b0-40a5-b5db-aa5e923e909e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:01.580048 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e6f5cc22-30b0-40a5-b5db-aa5e923e909e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:01.672622 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-44a211b4-5dae-491b-9694-d9b53d1af586 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:01.673328 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-44a211b4-5dae-491b-9694-d9b53d1af586 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:01.680542 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-44a211b4-5dae-491b-9694-d9b53d1af586 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:01.681020 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-44a211b4-5dae-491b-9694-d9b53d1af586 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:01.681976 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-44a211b4-5dae-491b-9694-d9b53d1af586 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:01.682571 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-44a211b4-5dae-491b-9694-d9b53d1af586 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:01.797530 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-e6f5cc22-30b0-40a5-b5db-aa5e923e909e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:01.808540 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-e6f5cc22-30b0-40a5-b5db-aa5e923e909e tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55" status: 200 len: 1314 microversion: 2.1 time: 0.245250 Jul 05 16:12:01.809714 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 225/440] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:01 2022] GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:01.865592 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-44a211b4-5dae-491b-9694-d9b53d1af586 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:01.880597 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-44a211b4-5dae-491b-9694-d9b53d1af586 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:01.882379 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-44a211b4-5dae-491b-9694-d9b53d1af586 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:01.883826 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-44a211b4-5dae-491b-9694-d9b53d1af586 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1807 microversion: 2.20 time: 0.218975 Jul 05 16:12:01.884872 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 216/441] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:12:01 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1807 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:12:02.826215 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-ae50e810-98f8-4999-b244-5b04787d79d8 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:02.827031 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-ae50e810-98f8-4999-b244-5b04787d79d8 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 352bc2a1-37ac-4578-8931-9ccb50d45e55] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:02.833785 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ae50e810-98f8-4999-b244-5b04787d79d8 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:02.834233 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ae50e810-98f8-4999-b244-5b04787d79d8 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:02.834994 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ae50e810-98f8-4999-b244-5b04787d79d8 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:02.835424 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ae50e810-98f8-4999-b244-5b04787d79d8 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:02.908683 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-893734a9-0611-459c-889d-4610301e1748 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:02.910001 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-893734a9-0611-459c-889d-4610301e1748 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:02.919706 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-893734a9-0611-459c-889d-4610301e1748 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:02.922372 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-893734a9-0611-459c-889d-4610301e1748 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:02.931663 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-893734a9-0611-459c-889d-4610301e1748 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:02.932135 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-893734a9-0611-459c-889d-4610301e1748 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:03.127012 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-ae50e810-98f8-4999-b244-5b04787d79d8 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:03.139903 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-ae50e810-98f8-4999-b244-5b04787d79d8 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55" status: 200 len: 1314 microversion: 2.1 time: 0.318021 Jul 05 16:12:03.142904 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 226/442] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:02 2022] GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:03.217001 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-893734a9-0611-459c-889d-4610301e1748 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:03.228585 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-893734a9-0611-459c-889d-4610301e1748 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:03.235227 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-893734a9-0611-459c-889d-4610301e1748 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:03.235227 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-893734a9-0611-459c-889d-4610301e1748 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1807 microversion: 2.20 time: 0.326864 Jul 05 16:12:03.235227 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 217/443] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:12:02 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1807 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:12:04.158163 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-22a2182f-a9cc-4458-9079-24336bd77514 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:04.158807 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-22a2182f-a9cc-4458-9079-24336bd77514 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 352bc2a1-37ac-4578-8931-9ccb50d45e55] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:04.165953 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-22a2182f-a9cc-4458-9079-24336bd77514 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:04.166400 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-22a2182f-a9cc-4458-9079-24336bd77514 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:04.167171 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-22a2182f-a9cc-4458-9079-24336bd77514 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:04.167782 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-22a2182f-a9cc-4458-9079-24336bd77514 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:04.251947 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-8635f11b-ce5b-4cce-b0d8-6f717b5ef0ca tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:04.252578 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-8635f11b-ce5b-4cce-b0d8-6f717b5ef0ca tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:04.260231 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8635f11b-ce5b-4cce-b0d8-6f717b5ef0ca tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:04.261019 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8635f11b-ce5b-4cce-b0d8-6f717b5ef0ca tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:04.262150 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8635f11b-ce5b-4cce-b0d8-6f717b5ef0ca tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:04.262760 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8635f11b-ce5b-4cce-b0d8-6f717b5ef0ca tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:04.371307 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-22a2182f-a9cc-4458-9079-24336bd77514 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:04.379030 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-22a2182f-a9cc-4458-9079-24336bd77514 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55" status: 200 len: 1314 microversion: 2.1 time: 0.224660 Jul 05 16:12:04.379606 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 227/444] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:04 2022] GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:04.503906 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-8635f11b-ce5b-4cce-b0d8-6f717b5ef0ca tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:04.520874 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-8635f11b-ce5b-4cce-b0d8-6f717b5ef0ca tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:04.522646 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-8635f11b-ce5b-4cce-b0d8-6f717b5ef0ca tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:04.523879 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-8635f11b-ce5b-4cce-b0d8-6f717b5ef0ca tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1807 microversion: 2.20 time: 0.276157 Jul 05 16:12:04.534943 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 218/445] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:12:04 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1807 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:12:05.398687 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-389e650a-3492-4371-bd74-41ae78177cc7 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:05.399434 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-389e650a-3492-4371-bd74-41ae78177cc7 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 352bc2a1-37ac-4578-8931-9ccb50d45e55] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:05.407271 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell0:SELECT=2 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:05.410368 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-389e650a-3492-4371-bd74-41ae78177cc7 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:05.410368 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-389e650a-3492-4371-bd74-41ae78177cc7 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:05.418459 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-389e650a-3492-4371-bd74-41ae78177cc7 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:05.419405 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-389e650a-3492-4371-bd74-41ae78177cc7 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:05.543066 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-562ee3a4-ad03-4790-acb2-2c3c2cb616f3 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:05.554578 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-562ee3a4-ad03-4790-acb2-2c3c2cb616f3 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:05.556575 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-562ee3a4-ad03-4790-acb2-2c3c2cb616f3 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:05.557269 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-562ee3a4-ad03-4790-acb2-2c3c2cb616f3 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:05.558256 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-562ee3a4-ad03-4790-acb2-2c3c2cb616f3 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:05.558696 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-562ee3a4-ad03-4790-acb2-2c3c2cb616f3 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:05.698868 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell0:SELECT=8 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:05.772032 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-389e650a-3492-4371-bd74-41ae78177cc7 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:05.782977 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-389e650a-3492-4371-bd74-41ae78177cc7 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55" status: 200 len: 1314 microversion: 2.1 time: 0.389153 Jul 05 16:12:05.788954 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 228/446] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:05 2022] GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55 => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:05.836218 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-562ee3a4-ad03-4790-acb2-2c3c2cb616f3 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:05.859773 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-562ee3a4-ad03-4790-acb2-2c3c2cb616f3 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:05.872539 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-562ee3a4-ad03-4790-acb2-2c3c2cb616f3 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:05.875400 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-562ee3a4-ad03-4790-acb2-2c3c2cb616f3 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1807 microversion: 2.20 time: 0.336707 Jul 05 16:12:05.886643 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 219/447] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:12:05 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1807 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:12:06.800044 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-fc933d07-3c13-4063-8438-459d841702eb tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:06.801468 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-fc933d07-3c13-4063-8438-459d841702eb tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 352bc2a1-37ac-4578-8931-9ccb50d45e55] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:06.819560 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fc933d07-3c13-4063-8438-459d841702eb tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:06.820247 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fc933d07-3c13-4063-8438-459d841702eb tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:06.823872 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fc933d07-3c13-4063-8438-459d841702eb tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:06.824782 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fc933d07-3c13-4063-8438-459d841702eb tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:06.901066 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-e64eeffa-06c4-4326-a496-1baa35d29839 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:06.902440 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-e64eeffa-06c4-4326-a496-1baa35d29839 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:06.910626 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e64eeffa-06c4-4326-a496-1baa35d29839 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:06.911873 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e64eeffa-06c4-4326-a496-1baa35d29839 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:06.912968 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e64eeffa-06c4-4326-a496-1baa35d29839 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:06.913691 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e64eeffa-06c4-4326-a496-1baa35d29839 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:07.295709 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-e64eeffa-06c4-4326-a496-1baa35d29839 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:07.301457 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-fc933d07-3c13-4063-8438-459d841702eb tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:07.309097 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-e64eeffa-06c4-4326-a496-1baa35d29839 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:07.311877 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-e64eeffa-06c4-4326-a496-1baa35d29839 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:07.313379 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-e64eeffa-06c4-4326-a496-1baa35d29839 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1807 microversion: 2.20 time: 0.420742 Jul 05 16:12:07.314322 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:07.317267 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-fc933d07-3c13-4063-8438-459d841702eb tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55" status: 200 len: 1314 microversion: 2.1 time: 0.521631 Jul 05 16:12:07.322399 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 229/448] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:06 2022] GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55 => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:07.331221 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 220/449] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:12:06 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1807 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:12:08.337451 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-8fe4d7b9-ae73-4900-a87b-d488b6934643 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:08.338050 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-8fe4d7b9-ae73-4900-a87b-d488b6934643 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:08.350639 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-3c24fa9d-cb20-4e0f-a3ba-2a2bdaa9df56 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:08.353029 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-3c24fa9d-cb20-4e0f-a3ba-2a2bdaa9df56 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 352bc2a1-37ac-4578-8931-9ccb50d45e55] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:08.358556 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8fe4d7b9-ae73-4900-a87b-d488b6934643 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:08.360284 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8fe4d7b9-ae73-4900-a87b-d488b6934643 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:08.362429 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8fe4d7b9-ae73-4900-a87b-d488b6934643 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:08.363663 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8fe4d7b9-ae73-4900-a87b-d488b6934643 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:08.371589 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3c24fa9d-cb20-4e0f-a3ba-2a2bdaa9df56 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:08.374472 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3c24fa9d-cb20-4e0f-a3ba-2a2bdaa9df56 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:08.378036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3c24fa9d-cb20-4e0f-a3ba-2a2bdaa9df56 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:08.378709 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3c24fa9d-cb20-4e0f-a3ba-2a2bdaa9df56 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:08.707235 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-8fe4d7b9-ae73-4900-a87b-d488b6934643 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:08.735910 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-3c24fa9d-cb20-4e0f-a3ba-2a2bdaa9df56 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:08.745753 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-3c24fa9d-cb20-4e0f-a3ba-2a2bdaa9df56 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55" status: 200 len: 1314 microversion: 2.1 time: 0.397332 Jul 05 16:12:08.748724 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 221/450] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:08 2022] GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55 => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:12:08.753739 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-8fe4d7b9-ae73-4900-a87b-d488b6934643 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:08.763616 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-8fe4d7b9-ae73-4900-a87b-d488b6934643 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:08.765053 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-8fe4d7b9-ae73-4900-a87b-d488b6934643 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1807 microversion: 2.20 time: 0.434038 Jul 05 16:12:08.767764 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 230/451] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:12:08 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1807 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:12:09.769981 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-d076b102-9e80-4e69-a6d3-97bf6d788ada tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:09.771107 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-d076b102-9e80-4e69-a6d3-97bf6d788ada tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 352bc2a1-37ac-4578-8931-9ccb50d45e55] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:09.780481 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d076b102-9e80-4e69-a6d3-97bf6d788ada tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:09.781055 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d076b102-9e80-4e69-a6d3-97bf6d788ada tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:09.781846 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d076b102-9e80-4e69-a6d3-97bf6d788ada tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:09.782485 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d076b102-9e80-4e69-a6d3-97bf6d788ada tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:09.785794 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-1e31e682-3702-45f9-b3e2-13f88abf7606 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:09.786968 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-1e31e682-3702-45f9-b3e2-13f88abf7606 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:09.793871 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1e31e682-3702-45f9-b3e2-13f88abf7606 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:09.794428 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1e31e682-3702-45f9-b3e2-13f88abf7606 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:09.795596 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1e31e682-3702-45f9-b3e2-13f88abf7606 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:09.796216 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1e31e682-3702-45f9-b3e2-13f88abf7606 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:10.105253 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-d076b102-9e80-4e69-a6d3-97bf6d788ada tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:10.119213 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-1e31e682-3702-45f9-b3e2-13f88abf7606 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:10.127941 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-d076b102-9e80-4e69-a6d3-97bf6d788ada tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55" status: 200 len: 1314 microversion: 2.1 time: 0.367488 Jul 05 16:12:10.128550 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 222/452] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:09 2022] GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55 => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:10.140024 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-1e31e682-3702-45f9-b3e2-13f88abf7606 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:10.142150 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-1e31e682-3702-45f9-b3e2-13f88abf7606 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:10.143484 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-1e31e682-3702-45f9-b3e2-13f88abf7606 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1807 microversion: 2.20 time: 0.361792 Jul 05 16:12:10.149767 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 231/453] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:12:09 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1807 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:12:11.145391 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-c5ffdad0-d105-4c27-b0f4-ba9ca70a697b tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:11.146686 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-c5ffdad0-d105-4c27-b0f4-ba9ca70a697b tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 352bc2a1-37ac-4578-8931-9ccb50d45e55] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:11.154653 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c5ffdad0-d105-4c27-b0f4-ba9ca70a697b tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:11.155843 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c5ffdad0-d105-4c27-b0f4-ba9ca70a697b tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:11.157011 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c5ffdad0-d105-4c27-b0f4-ba9ca70a697b tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:11.157646 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c5ffdad0-d105-4c27-b0f4-ba9ca70a697b tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:11.174039 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-ed750be0-6bfe-437b-a635-777c68c98c76 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:11.177058 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-ed750be0-6bfe-437b-a635-777c68c98c76 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:11.194154 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:11.198794 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ed750be0-6bfe-437b-a635-777c68c98c76 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:11.199804 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ed750be0-6bfe-437b-a635-777c68c98c76 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:11.202040 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ed750be0-6bfe-437b-a635-777c68c98c76 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:11.202819 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ed750be0-6bfe-437b-a635-777c68c98c76 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:11.436895 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c5ffdad0-d105-4c27-b0f4-ba9ca70a697b tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:11.450759 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-c5ffdad0-d105-4c27-b0f4-ba9ca70a697b tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55" status: 200 len: 1314 microversion: 2.1 time: 0.309190 Jul 05 16:12:11.453195 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 223/454] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:11 2022] GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:11.455197 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-ed750be0-6bfe-437b-a635-777c68c98c76 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:11.464443 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-ed750be0-6bfe-437b-a635-777c68c98c76 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:11.467168 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-ed750be0-6bfe-437b-a635-777c68c98c76 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:11.468871 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-ed750be0-6bfe-437b-a635-777c68c98c76 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1807 microversion: 2.20 time: 0.305123 Jul 05 16:12:11.470110 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 232/455] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:12:11 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1807 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:12:12.468487 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-4f1a829b-7c37-4332-a340-3d1696fa70e5 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:12.469324 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-4f1a829b-7c37-4332-a340-3d1696fa70e5 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 352bc2a1-37ac-4578-8931-9ccb50d45e55] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:12.476760 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4f1a829b-7c37-4332-a340-3d1696fa70e5 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:12.477322 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4f1a829b-7c37-4332-a340-3d1696fa70e5 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:12.478304 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4f1a829b-7c37-4332-a340-3d1696fa70e5 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:12.478842 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4f1a829b-7c37-4332-a340-3d1696fa70e5 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:12.491344 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-36df26e2-55e9-45e7-bfd0-518f11bee115 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:12.492654 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-36df26e2-55e9-45e7-bfd0-518f11bee115 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:12.501476 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-36df26e2-55e9-45e7-bfd0-518f11bee115 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:12.502203 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-36df26e2-55e9-45e7-bfd0-518f11bee115 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:12.504002 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-36df26e2-55e9-45e7-bfd0-518f11bee115 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:12.504590 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-36df26e2-55e9-45e7-bfd0-518f11bee115 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:12.737344 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-4f1a829b-7c37-4332-a340-3d1696fa70e5 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:12.747545 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-4f1a829b-7c37-4332-a340-3d1696fa70e5 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55" status: 200 len: 1314 microversion: 2.1 time: 0.282533 Jul 05 16:12:12.753303 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-36df26e2-55e9-45e7-bfd0-518f11bee115 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:12.753609 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 224/456] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:12 2022] GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:12.765934 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-36df26e2-55e9-45e7-bfd0-518f11bee115 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:12.767595 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-36df26e2-55e9-45e7-bfd0-518f11bee115 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:12.768807 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-36df26e2-55e9-45e7-bfd0-518f11bee115 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1807 microversion: 2.20 time: 0.284731 Jul 05 16:12:12.769371 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 233/457] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:12:12 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1807 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:12:13.765550 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-1161b7a0-9d1a-4eb6-bdd7-e9deeae05279 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:13.766506 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-1161b7a0-9d1a-4eb6-bdd7-e9deeae05279 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 352bc2a1-37ac-4578-8931-9ccb50d45e55] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:13.787025 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-6a75c7d7-11b8-4d4b-bc1a-afacf9af0f0a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:13.787632 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1161b7a0-9d1a-4eb6-bdd7-e9deeae05279 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:13.788096 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1161b7a0-9d1a-4eb6-bdd7-e9deeae05279 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:13.790985 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1161b7a0-9d1a-4eb6-bdd7-e9deeae05279 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:13.791397 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-6a75c7d7-11b8-4d4b-bc1a-afacf9af0f0a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:13.791540 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1161b7a0-9d1a-4eb6-bdd7-e9deeae05279 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:13.800555 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-6a75c7d7-11b8-4d4b-bc1a-afacf9af0f0a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:13.801036 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-6a75c7d7-11b8-4d4b-bc1a-afacf9af0f0a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:13.801821 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-6a75c7d7-11b8-4d4b-bc1a-afacf9af0f0a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:13.802260 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-6a75c7d7-11b8-4d4b-bc1a-afacf9af0f0a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:14.018676 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-6a75c7d7-11b8-4d4b-bc1a-afacf9af0f0a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:14.036982 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-6a75c7d7-11b8-4d4b-bc1a-afacf9af0f0a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:14.040661 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-6a75c7d7-11b8-4d4b-bc1a-afacf9af0f0a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:14.042267 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-1161b7a0-9d1a-4eb6-bdd7-e9deeae05279 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:14.047182 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-6a75c7d7-11b8-4d4b-bc1a-afacf9af0f0a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1807 microversion: 2.20 time: 0.264087 Jul 05 16:12:14.057577 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 234/458] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:12:13 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1807 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:12:14.061144 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-1161b7a0-9d1a-4eb6-bdd7-e9deeae05279 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55" status: 200 len: 1314 microversion: 2.1 time: 0.299181 Jul 05 16:12:14.071549 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 225/459] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:13 2022] GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:15.065518 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-52385ea7-ed74-4015-a26b-ebba89839871 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:15.066086 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-52385ea7-ed74-4015-a26b-ebba89839871 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:15.078801 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-48d67252-4b35-4f13-b98f-d5705bf2256d tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:15.080014 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-48d67252-4b35-4f13-b98f-d5705bf2256d tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 352bc2a1-37ac-4578-8931-9ccb50d45e55] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:15.080182 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-52385ea7-ed74-4015-a26b-ebba89839871 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:15.080636 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-52385ea7-ed74-4015-a26b-ebba89839871 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:15.081439 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-52385ea7-ed74-4015-a26b-ebba89839871 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:15.081870 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-52385ea7-ed74-4015-a26b-ebba89839871 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:15.088410 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-48d67252-4b35-4f13-b98f-d5705bf2256d tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:15.089124 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-48d67252-4b35-4f13-b98f-d5705bf2256d tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:15.090068 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-48d67252-4b35-4f13-b98f-d5705bf2256d tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:15.090667 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-48d67252-4b35-4f13-b98f-d5705bf2256d tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:15.315831 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-52385ea7-ed74-4015-a26b-ebba89839871 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:15.327108 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-52385ea7-ed74-4015-a26b-ebba89839871 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:15.328906 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-52385ea7-ed74-4015-a26b-ebba89839871 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:15.330418 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-52385ea7-ed74-4015-a26b-ebba89839871 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1807 microversion: 2.20 time: 0.268788 Jul 05 16:12:15.338321 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 235/460] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:12:15 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1807 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:12:15.357887 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-48d67252-4b35-4f13-b98f-d5705bf2256d tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:15.366995 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-48d67252-4b35-4f13-b98f-d5705bf2256d tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55" status: 200 len: 1314 microversion: 2.1 time: 0.291924 Jul 05 16:12:15.376518 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 226/461] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:15 2022] GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:15.742787 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [req-15243646-6a16-450a-a370-ecd630d85a24 req-ca166c37-b078-47fb-9439-a3c4a07e3a82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "352bc2a1-37ac-4578-8931-9ccb50d45e55", "name": "network-vif-plugged", "status": "completed", "tag": "facb9c57-f5b3-48fc-91c3-b67f526ada63"}]} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:12:15.751281 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-15243646-6a16-450a-a370-ecd630d85a24 req-ca166c37-b078-47fb-9439-a3c4a07e3a82 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:15.751730 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-15243646-6a16-450a-a370-ecd630d85a24 req-ca166c37-b078-47fb-9439-a3c4a07e3a82 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:15.766047 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.compute.server_external_events [req-15243646-6a16-450a-a370-ecd630d85a24 req-ca166c37-b078-47fb-9439-a3c4a07e3a82 service nova] Creating event network-vif-plugged:facb9c57-f5b3-48fc-91c3-b67f526ada63 for instance 352bc2a1-37ac-4578-8931-9ccb50d45e55 on hv-cinder-84875 Jul 05 16:12:15.771085 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [req-15243646-6a16-450a-a370-ecd630d85a24 req-ca166c37-b078-47fb-9439-a3c4a07e3a82 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032544 Jul 05 16:12:15.771689 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 236/462] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:12:16.350174 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-fcd0e61e-0ff9-40ee-ae54-f6d46f802abe tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:16.351887 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-fcd0e61e-0ff9-40ee-ae54-f6d46f802abe tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:16.358456 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fcd0e61e-0ff9-40ee-ae54-f6d46f802abe tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:16.359140 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fcd0e61e-0ff9-40ee-ae54-f6d46f802abe tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:16.360180 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fcd0e61e-0ff9-40ee-ae54-f6d46f802abe tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:16.360795 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fcd0e61e-0ff9-40ee-ae54-f6d46f802abe tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:16.384664 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-987b2911-5eb9-4491-9784-80ff9affce59 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:16.385397 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-987b2911-5eb9-4491-9784-80ff9affce59 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 352bc2a1-37ac-4578-8931-9ccb50d45e55] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:16.402157 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-987b2911-5eb9-4491-9784-80ff9affce59 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:16.402663 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-987b2911-5eb9-4491-9784-80ff9affce59 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:16.403465 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-987b2911-5eb9-4491-9784-80ff9affce59 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:16.403905 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-987b2911-5eb9-4491-9784-80ff9affce59 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:16.625112 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-fcd0e61e-0ff9-40ee-ae54-f6d46f802abe tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:16.633662 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-987b2911-5eb9-4491-9784-80ff9affce59 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:16.635041 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-fcd0e61e-0ff9-40ee-ae54-f6d46f802abe tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:16.637194 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-fcd0e61e-0ff9-40ee-ae54-f6d46f802abe tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:16.638686 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-fcd0e61e-0ff9-40ee-ae54-f6d46f802abe tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1807 microversion: 2.20 time: 0.292686 Jul 05 16:12:16.640052 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 16:12:16.640432 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Tue Jul 5 16:12:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 (ip 10.222.0.45) !!! Jul 05 16:12:16.641981 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-987b2911-5eb9-4491-9784-80ff9affce59 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55" status: 200 len: 1314 microversion: 2.1 time: 0.262159 Jul 05 16:12:16.649275 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 237/463] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:16 2022] GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:16.650649 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 227/464] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:12:16 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1807 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:12:17.660300 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-0840316a-6c9d-4462-af11-4f43a767b389 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:17.660813 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-ae36b968-c11b-41c8-968a-10e8ee96cc35 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:17.668204 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-0840316a-6c9d-4462-af11-4f43a767b389 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:17.673014 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-ae36b968-c11b-41c8-968a-10e8ee96cc35 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 352bc2a1-37ac-4578-8931-9ccb50d45e55] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:17.681921 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ae36b968-c11b-41c8-968a-10e8ee96cc35 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:17.682727 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ae36b968-c11b-41c8-968a-10e8ee96cc35 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:17.683777 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ae36b968-c11b-41c8-968a-10e8ee96cc35 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:17.684363 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ae36b968-c11b-41c8-968a-10e8ee96cc35 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:17.684896 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0840316a-6c9d-4462-af11-4f43a767b389 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:17.685352 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0840316a-6c9d-4462-af11-4f43a767b389 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:17.686132 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0840316a-6c9d-4462-af11-4f43a767b389 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:17.692368 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0840316a-6c9d-4462-af11-4f43a767b389 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:17.944376 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-0840316a-6c9d-4462-af11-4f43a767b389 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:17.958355 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-0840316a-6c9d-4462-af11-4f43a767b389 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:17.960849 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-0840316a-6c9d-4462-af11-4f43a767b389 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:17.965938 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-0840316a-6c9d-4462-af11-4f43a767b389 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1807 microversion: 2.20 time: 0.309528 Jul 05 16:12:17.969075 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 238/465] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:12:17 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1807 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:12:18.394349 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-ae36b968-c11b-41c8-968a-10e8ee96cc35 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:18.402305 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-ae36b968-c11b-41c8-968a-10e8ee96cc35 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55" status: 200 len: 1314 microversion: 2.1 time: 0.745633 Jul 05 16:12:18.404099 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 228/466] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:17 2022] GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55 => generated 1314 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:18.628405 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-865214f2-2028-416e-b43f-cb44eeee86c9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b93ba52f-6676-4661-8815-bfc20f0eb022"}} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:12:18.630242 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-865214f2-2028-416e-b43f-cb44eeee86c9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:18.638098 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-865214f2-2028-416e-b43f-cb44eeee86c9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:18.638875 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-865214f2-2028-416e-b43f-cb44eeee86c9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:18.639882 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-865214f2-2028-416e-b43f-cb44eeee86c9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:18.640524 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-865214f2-2028-416e-b43f-cb44eeee86c9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:18.988728 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-16c92702-07fe-4739-96f6-ce86ab8c9bd0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:18.990278 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-16c92702-07fe-4739-96f6-ce86ab8c9bd0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:18.996717 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_api:SELECT=58 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:18.998937 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-16c92702-07fe-4739-96f6-ce86ab8c9bd0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:19.002737 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-16c92702-07fe-4739-96f6-ce86ab8c9bd0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:19.003837 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-16c92702-07fe-4739-96f6-ce86ab8c9bd0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:19.006298 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-16c92702-07fe-4739-96f6-ce86ab8c9bd0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:19.187389 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-16c92702-07fe-4739-96f6-ce86ab8c9bd0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:19.198963 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-16c92702-07fe-4739-96f6-ce86ab8c9bd0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:19.203339 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-16c92702-07fe-4739-96f6-ce86ab8c9bd0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:19.203339 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-16c92702-07fe-4739-96f6-ce86ab8c9bd0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1807 microversion: 2.20 time: 0.219010 Jul 05 16:12:19.213634 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 229/467] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:12:18 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1807 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:12:19.422335 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-7295acf7-fef7-46c4-b8f7-e8d0ba1d89cb tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:19.423338 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-7295acf7-fef7-46c4-b8f7-e8d0ba1d89cb tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 352bc2a1-37ac-4578-8931-9ccb50d45e55] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:19.437238 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7295acf7-fef7-46c4-b8f7-e8d0ba1d89cb tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:19.438085 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7295acf7-fef7-46c4-b8f7-e8d0ba1d89cb tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:19.439118 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7295acf7-fef7-46c4-b8f7-e8d0ba1d89cb tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:19.439934 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7295acf7-fef7-46c4-b8f7-e8d0ba1d89cb tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:19.613842 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-7295acf7-fef7-46c4-b8f7-e8d0ba1d89cb tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:19.626299 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-7295acf7-fef7-46c4-b8f7-e8d0ba1d89cb tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55" status: 200 len: 1497 microversion: 2.1 time: 0.209699 Jul 05 16:12:19.627142 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 230/468] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:19 2022] GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55 => generated 1497 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:19.639342 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-a229419d-0ea0-4433-8457-9bb5411ec0f6 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:19.640898 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-a229419d-0ea0-4433-8457-9bb5411ec0f6 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 82eccf63-469a-47ea-aab4-536d6210c066] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:19.648631 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a229419d-0ea0-4433-8457-9bb5411ec0f6 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:19.649119 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a229419d-0ea0-4433-8457-9bb5411ec0f6 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:19.649905 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a229419d-0ea0-4433-8457-9bb5411ec0f6 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:19.650347 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a229419d-0ea0-4433-8457-9bb5411ec0f6 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:19.683336 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-a229419d-0ea0-4433-8457-9bb5411ec0f6 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066/ips" status: 200 len: 150 microversion: 2.1 time: 0.048291 Jul 05 16:12:19.683945 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 231/469] 10.222.0.45 () {58 vars in 1247 bytes} [Tue Jul 5 16:12:19 2022] GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066/ips => generated 150 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:12:19.690658 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-eb273877-6ccc-4597-8790-a81b5816d9a1 req-0f573e88-7271-4295-88ab-7618f2c02b60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da368d38-2642-49c3-b499-eb5a977cbd77", "name": "network-vif-plugged", "status": "completed", "tag": "c24636dc-9b24-45b5-a963-180931342e24"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:12:19.699961 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-eb273877-6ccc-4597-8790-a81b5816d9a1 req-0f573e88-7271-4295-88ab-7618f2c02b60 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:19.700414 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-eb273877-6ccc-4597-8790-a81b5816d9a1 req-0f573e88-7271-4295-88ab-7618f2c02b60 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:19.705013 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=100 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:19.719220 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-eb273877-6ccc-4597-8790-a81b5816d9a1 req-0f573e88-7271-4295-88ab-7618f2c02b60 service nova] Creating event network-vif-plugged:c24636dc-9b24-45b5-a963-180931342e24 for instance da368d38-2642-49c3-b499-eb5a977cbd77 on hv-cinder-84875 Jul 05 16:12:19.727118 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-eb273877-6ccc-4597-8790-a81b5816d9a1 req-0f573e88-7271-4295-88ab-7618f2c02b60 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041153 Jul 05 16:12:19.733373 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 232/470] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:12:19.741032 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-11dfd5a0-6c06-4a96-af11-a947264ff506 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "781b0d96-f540-40d0-bfe6-6478ffade503"}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:12:19.743629 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-11dfd5a0-6c06-4a96-af11-a947264ff506 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 82eccf63-469a-47ea-aab4-536d6210c066] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:19.751332 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-11dfd5a0-6c06-4a96-af11-a947264ff506 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:19.753110 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-11dfd5a0-6c06-4a96-af11-a947264ff506 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:19.754537 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-11dfd5a0-6c06-4a96-af11-a947264ff506 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:19.755195 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-11dfd5a0-6c06-4a96-af11-a947264ff506 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:19.863068 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-11dfd5a0-6c06-4a96-af11-a947264ff506 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] HTTP exception thrown: Invalid volume: volume 781b0d96-f540-40d0-bfe6-6478ffade503 is already attached to instances: 478dac11-75cf-4e58-9ba7-e78469b8045a Jul 05 16:12:19.866541 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-11dfd5a0-6c06-4a96-af11-a947264ff506 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Request method failure captured: Jul 05 16:12:19.866541 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: POST /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066/os-volume_attachments HTTP/1.1 Jul 05 16:12:19.866541 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:12:19.866541 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:12:19.866541 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:12:19.866541 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 74 Jul 05 16:12:19.866541 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:12:19.866541 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:12:19.866541 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:12:19.866541 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:12:19.866541 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIcG6oJHBbOiV-hRrdMXuy13iZZ6hvCfk-vTWz4vq2ula5Qwq5GKAKhC7pohxgL-mMXAkQ0I8c07z_L-klhBhC6mFKTl8PgxIghG2kxSHmXvGruMCHGJe1XXCXlDVgGJeXVlaQZZep4KSMSbhku1jx5l6fL00FOe6C27ag91K3fk98 Jul 05 16:12:19.866541 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:12:19.866541 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:12:19.866541 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:12:19.866541 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:12:19.866541 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:12:19.866541 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:12:19.866541 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 42e6ad67dbf542528726c545872ac10c Jul 05 16:12:19.866541 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:12:19.866541 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:12:19.866541 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:12:19.867936 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_42e6ad67dbf542528726c545872ac10c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:12:19.867936 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:12:19.867936 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 42e6ad67dbf542528726c545872ac10c Jul 05 16:12:19.867936 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:12:19.867936 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-AttachVolumeNegativeTest-547019280-project Jul 05 16:12:19.867936 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:12:19.867936 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:12:19.867936 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: 0c8512e7c1704fac9cc4fcfe3bf1f18b Jul 05 16:12:19.867936 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-AttachVolumeNegativeTest-547019280-project Jul 05 16:12:19.867936 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Jul 05 16:12:19.867936 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {"volumeAttachment": {"volumeId": "781b0d96-f540-40d0-bfe6-6478ffade503"}} Jul 05 16:12:19.867936 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:12:19.868985 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Invalid volume: volume 781b0d96-f540-40d0-bfe6-6478ffade503 is already attached to instances: 478dac11-75cf-4e58-9ba7-e78469b8045a Jul 05 16:12:19.868985 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'server_id': '82eccf63-469a-47ea-aab4-536d6210c066', 'body': {'volumeAttachment': {'volumeId': '781b0d96-f540-40d0-bfe6-6478ffade503'}}} Jul 05 16:12:19.868985 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:12:19.868985 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:12:19.868985 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 05 16:12:19.868985 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 05 16:12:19.868985 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 05 16:12:19.868985 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 05 16:12:19.868985 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 05 16:12:19.868985 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 05 16:12:19.868985 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 05 16:12:19.868985 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 05 16:12:19.868985 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 05 16:12:19.868985 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 05 16:12:19.868985 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 781b0d96-f540-40d0-bfe6-6478ffade503 is already attached to instances: 478dac11-75cf-4e58-9ba7-e78469b8045a Jul 05 16:12:19.868985 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:12:19.868985 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:12:19.868985 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:12:19.868985 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:12:19.870235 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:12:19.870235 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:12:19.870235 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:12:19.870235 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:12:19.870235 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:12:19.870235 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:12:19.870235 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 16:12:19.870235 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 16:12:19.870235 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 16:12:19.870235 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 16:12:19.870235 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 16:12:19.870235 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 16:12:19.870235 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 05 16:12:19.870235 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 05 16:12:19.870235 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 781b0d96-f540-40d0-bfe6-6478ffade503 is already attached to instances: 478dac11-75cf-4e58-9ba7-e78469b8045a Jul 05 16:12:19.870235 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:12:19.870235 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:12:19.870235 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:12:19.870235 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:12:19.870235 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:12:19.871491 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:12:19.871491 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:12:19.871491 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:12:19.871491 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 781b0d96-f540-40d0-bfe6-6478ffade503 is already attached to instances: 478dac11-75cf-4e58-9ba7-e78469b8045a Jul 05 16:12:19.871491 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:12:19.871491 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-11dfd5a0-6c06-4a96-af11-a947264ff506 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Returning 400 to user: Invalid volume: volume 781b0d96-f540-40d0-bfe6-6478ffade503 is already attached to instances: 478dac11-75cf-4e58-9ba7-e78469b8045a {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:12:19.871491 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-11dfd5a0-6c06-4a96-af11-a947264ff506 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "POST /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.134825 Jul 05 16:12:19.871491 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 233/471] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Jul 5 16:12:19 2022] POST /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066/os-volume_attachments => generated 174 bytes in 138 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 05 16:12:19.879087 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-efd64d84-d6c1-4929-aab4-d6cacc314cdd tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:19.879600 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-efd64d84-d6c1-4929-aab4-d6cacc314cdd tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 82eccf63-469a-47ea-aab4-536d6210c066] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:19.905047 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-efd64d84-d6c1-4929-aab4-d6cacc314cdd tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:19.907062 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-efd64d84-d6c1-4929-aab4-d6cacc314cdd tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:19.907962 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-efd64d84-d6c1-4929-aab4-d6cacc314cdd tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:19.908486 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-efd64d84-d6c1-4929-aab4-d6cacc314cdd tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:19.952386 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-efd64d84-d6c1-4929-aab4-d6cacc314cdd tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 82eccf63-469a-47ea-aab4-536d6210c066] Going to try to terminate instance {{(pid=118320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 16:12:20.364985 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-efd64d84-d6c1-4929-aab4-d6cacc314cdd tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "DELETE /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066" status: 204 len: 0 microversion: 2.1 time: 0.487337 Jul 05 16:12:20.365740 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 234/472] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Jul 5 16:12:19 2022] DELETE /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 16:12:20.372267 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-db68ea8c-2e5d-4a95-9afd-cf8499039431 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:20.373011 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-db68ea8c-2e5d-4a95-9afd-cf8499039431 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:20.394705 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-db68ea8c-2e5d-4a95-9afd-cf8499039431 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:20.395567 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-db68ea8c-2e5d-4a95-9afd-cf8499039431 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:20.399001 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-db68ea8c-2e5d-4a95-9afd-cf8499039431 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:20.399460 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-db68ea8c-2e5d-4a95-9afd-cf8499039431 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:20.500418 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-865214f2-2028-416e-b43f-cb44eeee86c9 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "POST /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.876288 Jul 05 16:12:20.516626 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 239/473] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Jul 5 16:12:18 2022] POST /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261/os-volume_attachments => generated 194 bytes in 1893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:12:20.532815 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-b377b406-86e6-4a53-8d61-a92868bd071c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:20.533855 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-b377b406-86e6-4a53-8d61-a92868bd071c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 82eccf63-469a-47ea-aab4-536d6210c066] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:20.543190 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b377b406-86e6-4a53-8d61-a92868bd071c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:20.544263 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b377b406-86e6-4a53-8d61-a92868bd071c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:20.546496 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b377b406-86e6-4a53-8d61-a92868bd071c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:20.547207 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b377b406-86e6-4a53-8d61-a92868bd071c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:20.607597 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-db68ea8c-2e5d-4a95-9afd-cf8499039431 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:20.621149 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-db68ea8c-2e5d-4a95-9afd-cf8499039431 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:20.627248 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-db68ea8c-2e5d-4a95-9afd-cf8499039431 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:20.633499 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-db68ea8c-2e5d-4a95-9afd-cf8499039431 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1807 microversion: 2.20 time: 0.261318 Jul 05 16:12:20.636386 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 235/474] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:12:20 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1807 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:12:20.771373 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-b4d96c71-d854-4bd5-a653-5c42eeded5d6 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:20.772125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-b4d96c71-d854-4bd5-a653-5c42eeded5d6 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 352bc2a1-37ac-4578-8931-9ccb50d45e55] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:20.779193 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b4d96c71-d854-4bd5-a653-5c42eeded5d6 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:20.779786 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b4d96c71-d854-4bd5-a653-5c42eeded5d6 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:20.780850 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b4d96c71-d854-4bd5-a653-5c42eeded5d6 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:20.781376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b4d96c71-d854-4bd5-a653-5c42eeded5d6 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:20.819518 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-b377b406-86e6-4a53-8d61-a92868bd071c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:20.822421 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-b4d96c71-d854-4bd5-a653-5c42eeded5d6 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 352bc2a1-37ac-4578-8931-9ccb50d45e55] Going to try to terminate instance {{(pid=118320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 16:12:20.833838 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-b377b406-86e6-4a53-8d61-a92868bd071c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066" status: 200 len: 1682 microversion: 2.1 time: 0.313524 Jul 05 16:12:20.834874 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 240/475] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:20 2022] GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066 => generated 1682 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:21.171663 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-b4d96c71-d854-4bd5-a653-5c42eeded5d6 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "DELETE /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55" status: 204 len: 0 microversion: 2.1 time: 0.408947 Jul 05 16:12:21.172621 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 236/476] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Jul 5 16:12:20 2022] DELETE /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 05 16:12:21.180829 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-e6e4bb34-6e7a-420e-9d41-3831f38367ef tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:21.181452 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-e6e4bb34-6e7a-420e-9d41-3831f38367ef tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 352bc2a1-37ac-4578-8931-9ccb50d45e55] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:21.187826 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e6e4bb34-6e7a-420e-9d41-3831f38367ef tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:21.188467 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e6e4bb34-6e7a-420e-9d41-3831f38367ef tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:21.189440 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e6e4bb34-6e7a-420e-9d41-3831f38367ef tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:21.189979 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e6e4bb34-6e7a-420e-9d41-3831f38367ef tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:21.329619 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-e6e4bb34-6e7a-420e-9d41-3831f38367ef tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:21.337690 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-e6e4bb34-6e7a-420e-9d41-3831f38367ef tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55" status: 200 len: 1503 microversion: 2.1 time: 0.160795 Jul 05 16:12:21.338268 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 241/477] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:21 2022] GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:21.653648 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-c5c4a8b5-8e32-49d6-8542-31207c5b9cad tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:21.654749 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-c5c4a8b5-8e32-49d6-8542-31207c5b9cad tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:21.673358 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c5c4a8b5-8e32-49d6-8542-31207c5b9cad tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:21.673813 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c5c4a8b5-8e32-49d6-8542-31207c5b9cad tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:21.674588 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c5c4a8b5-8e32-49d6-8542-31207c5b9cad tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:21.675701 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c5c4a8b5-8e32-49d6-8542-31207c5b9cad tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:21.851726 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-caedfafb-2957-42c8-acbc-35611dcb4955 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:21.853026 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-caedfafb-2957-42c8-acbc-35611dcb4955 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 82eccf63-469a-47ea-aab4-536d6210c066] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:21.860613 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-caedfafb-2957-42c8-acbc-35611dcb4955 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:21.861352 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-caedfafb-2957-42c8-acbc-35611dcb4955 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:21.862117 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-caedfafb-2957-42c8-acbc-35611dcb4955 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:21.862546 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-caedfafb-2957-42c8-acbc-35611dcb4955 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:21.864138 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c5c4a8b5-8e32-49d6-8542-31207c5b9cad tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:21.875385 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c5c4a8b5-8e32-49d6-8542-31207c5b9cad tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:21.878337 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c5c4a8b5-8e32-49d6-8542-31207c5b9cad tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:21.879523 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-c5c4a8b5-8e32-49d6-8542-31207c5b9cad tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1807 microversion: 2.20 time: 0.231860 Jul 05 16:12:21.891234 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 237/478] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:12:21 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1807 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:12:22.078146 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-caedfafb-2957-42c8-acbc-35611dcb4955 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:22.091679 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-caedfafb-2957-42c8-acbc-35611dcb4955 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066" status: 200 len: 1682 microversion: 2.1 time: 0.243935 Jul 05 16:12:22.100945 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 242/479] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:21 2022] GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066 => generated 1682 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:12:22.357445 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-03984b93-c3d8-4cba-a4f1-8ba576ccffb1 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:22.358000 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-03984b93-c3d8-4cba-a4f1-8ba576ccffb1 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 352bc2a1-37ac-4578-8931-9ccb50d45e55] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:22.373082 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-03984b93-c3d8-4cba-a4f1-8ba576ccffb1 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:22.373500 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-03984b93-c3d8-4cba-a4f1-8ba576ccffb1 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:22.374489 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-03984b93-c3d8-4cba-a4f1-8ba576ccffb1 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:22.375088 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-03984b93-c3d8-4cba-a4f1-8ba576ccffb1 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:22.575291 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-03984b93-c3d8-4cba-a4f1-8ba576ccffb1 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:22.587080 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-03984b93-c3d8-4cba-a4f1-8ba576ccffb1 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55" status: 200 len: 1503 microversion: 2.1 time: 0.233856 Jul 05 16:12:22.587779 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 238/480] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:22 2022] GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55 => generated 1503 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:22.899160 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-d469aede-9570-4982-b650-dcf5dcab9d08 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:22.899909 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-d469aede-9570-4982-b650-dcf5dcab9d08 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:22.910997 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d469aede-9570-4982-b650-dcf5dcab9d08 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:22.911451 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d469aede-9570-4982-b650-dcf5dcab9d08 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:22.912218 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d469aede-9570-4982-b650-dcf5dcab9d08 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:22.912661 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d469aede-9570-4982-b650-dcf5dcab9d08 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:23.086596 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-d469aede-9570-4982-b650-dcf5dcab9d08 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:23.096586 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-d469aede-9570-4982-b650-dcf5dcab9d08 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:23.099021 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-d469aede-9570-4982-b650-dcf5dcab9d08 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:23.100985 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-d469aede-9570-4982-b650-dcf5dcab9d08 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1807 microversion: 2.20 time: 0.205951 Jul 05 16:12:23.101249 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 243/481] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:12:22 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1807 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:12:23.117359 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-1eb7cdb6-146e-4d48-be7c-ed6e00b69930 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:23.118775 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-1eb7cdb6-146e-4d48-be7c-ed6e00b69930 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 82eccf63-469a-47ea-aab4-536d6210c066] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:23.125070 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1eb7cdb6-146e-4d48-be7c-ed6e00b69930 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:23.125517 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1eb7cdb6-146e-4d48-be7c-ed6e00b69930 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:23.126316 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1eb7cdb6-146e-4d48-be7c-ed6e00b69930 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:23.126829 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1eb7cdb6-146e-4d48-be7c-ed6e00b69930 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:23.387012 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-1eb7cdb6-146e-4d48-be7c-ed6e00b69930 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:23.398125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-1eb7cdb6-146e-4d48-be7c-ed6e00b69930 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066" status: 200 len: 1682 microversion: 2.1 time: 0.285172 Jul 05 16:12:23.408862 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 239/482] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:23 2022] GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066 => generated 1682 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:23.604577 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-30c731c5-75c9-4092-a97c-d8bab70087b2 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:23.605697 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-30c731c5-75c9-4092-a97c-d8bab70087b2 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 352bc2a1-37ac-4578-8931-9ccb50d45e55] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:23.620435 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-30c731c5-75c9-4092-a97c-d8bab70087b2 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:23.622757 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-30c731c5-75c9-4092-a97c-d8bab70087b2 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:23.623842 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-30c731c5-75c9-4092-a97c-d8bab70087b2 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:23.627287 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-30c731c5-75c9-4092-a97c-d8bab70087b2 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:23.899688 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-30c731c5-75c9-4092-a97c-d8bab70087b2 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:23.924332 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-30c731c5-75c9-4092-a97c-d8bab70087b2 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55" status: 200 len: 1503 microversion: 2.1 time: 0.324526 Jul 05 16:12:23.933066 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 244/483] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:23 2022] GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55 => generated 1503 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:24.119242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-19130f71-05c4-4682-bebb-3fe9d0b5ff4c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:24.119860 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-19130f71-05c4-4682-bebb-3fe9d0b5ff4c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:24.127707 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-19130f71-05c4-4682-bebb-3fe9d0b5ff4c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:24.133003 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-19130f71-05c4-4682-bebb-3fe9d0b5ff4c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:24.137907 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-19130f71-05c4-4682-bebb-3fe9d0b5ff4c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:24.141002 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-19130f71-05c4-4682-bebb-3fe9d0b5ff4c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:24.419520 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-93ebf453-bf9d-425d-9571-4e98631d7c30 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:24.420135 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-93ebf453-bf9d-425d-9571-4e98631d7c30 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 82eccf63-469a-47ea-aab4-536d6210c066] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:24.428406 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-93ebf453-bf9d-425d-9571-4e98631d7c30 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:24.431865 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-93ebf453-bf9d-425d-9571-4e98631d7c30 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:24.432868 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-93ebf453-bf9d-425d-9571-4e98631d7c30 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:24.434895 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-93ebf453-bf9d-425d-9571-4e98631d7c30 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:24.547635 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-19130f71-05c4-4682-bebb-3fe9d0b5ff4c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:24.563204 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-19130f71-05c4-4682-bebb-3fe9d0b5ff4c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:24.568371 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-19130f71-05c4-4682-bebb-3fe9d0b5ff4c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:24.577391 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-19130f71-05c4-4682-bebb-3fe9d0b5ff4c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1807 microversion: 2.20 time: 0.454984 Jul 05 16:12:24.578088 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 240/484] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:12:24 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1807 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:12:24.644792 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-93ebf453-bf9d-425d-9571-4e98631d7c30 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:24.648556 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:24.656880 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-93ebf453-bf9d-425d-9571-4e98631d7c30 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066" status: 200 len: 1615 microversion: 2.1 time: 0.239125 Jul 05 16:12:24.660338 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 245/485] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:24 2022] GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066 => generated 1615 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:24.670083 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-c5351daa-df75-4eb6-a1b7-5d9d9d11fd9c req-6aa3dd87-0e46-4bd4-92ad-846e69da9faf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "352bc2a1-37ac-4578-8931-9ccb50d45e55", "name": "network-vif-deleted", "tag": "facb9c57-f5b3-48fc-91c3-b67f526ada63"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:12:24.681164 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-c5351daa-df75-4eb6-a1b7-5d9d9d11fd9c req-6aa3dd87-0e46-4bd4-92ad-846e69da9faf service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:24.681619 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-c5351daa-df75-4eb6-a1b7-5d9d9d11fd9c req-6aa3dd87-0e46-4bd4-92ad-846e69da9faf service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:24.695075 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-c5351daa-df75-4eb6-a1b7-5d9d9d11fd9c req-6aa3dd87-0e46-4bd4-92ad-846e69da9faf service nova] Creating event network-vif-deleted:facb9c57-f5b3-48fc-91c3-b67f526ada63 for instance 352bc2a1-37ac-4578-8931-9ccb50d45e55 on hv-cinder-84875 Jul 05 16:12:24.701155 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-c5351daa-df75-4eb6-a1b7-5d9d9d11fd9c req-6aa3dd87-0e46-4bd4-92ad-846e69da9faf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044848 Jul 05 16:12:24.705768 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 241/486] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:12:24.949373 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-cfb6df43-72bd-428d-ae3e-dcdbaecd570f tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:24.949995 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-cfb6df43-72bd-428d-ae3e-dcdbaecd570f tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 352bc2a1-37ac-4578-8931-9ccb50d45e55] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:24.977666 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cfb6df43-72bd-428d-ae3e-dcdbaecd570f tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:24.978117 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cfb6df43-72bd-428d-ae3e-dcdbaecd570f tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:24.996404 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cfb6df43-72bd-428d-ae3e-dcdbaecd570f tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:24.997076 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cfb6df43-72bd-428d-ae3e-dcdbaecd570f tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:25.014289 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-0f22fc2c-532c-4e25-80d0-1fdb6be77fd3 req-7394cb7b-1ac3-411a-9512-a59df5ecf1d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82eccf63-469a-47ea-aab4-536d6210c066", "name": "network-vif-deleted", "tag": "54f02c5c-3943-4041-9d1e-31e3fcfcdf17"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:12:25.033948 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-0f22fc2c-532c-4e25-80d0-1fdb6be77fd3 req-7394cb7b-1ac3-411a-9512-a59df5ecf1d4 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:25.034401 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-0f22fc2c-532c-4e25-80d0-1fdb6be77fd3 req-7394cb7b-1ac3-411a-9512-a59df5ecf1d4 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:25.073124 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-0f22fc2c-532c-4e25-80d0-1fdb6be77fd3 req-7394cb7b-1ac3-411a-9512-a59df5ecf1d4 service nova] Creating event network-vif-deleted:54f02c5c-3943-4041-9d1e-31e3fcfcdf17 for instance 82eccf63-469a-47ea-aab4-536d6210c066 on hv-cinder-84875 Jul 05 16:12:25.079063 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-0f22fc2c-532c-4e25-80d0-1fdb6be77fd3 req-7394cb7b-1ac3-411a-9512-a59df5ecf1d4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068692 Jul 05 16:12:25.082131 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 242/487] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:12:25.133731 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-cfb6df43-72bd-428d-ae3e-dcdbaecd570f tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:25.145025 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-cfb6df43-72bd-428d-ae3e-dcdbaecd570f tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55" status: 200 len: 1461 microversion: 2.1 time: 0.199325 Jul 05 16:12:25.156057 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 246/488] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:24 2022] GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55 => generated 1461 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:25.631098 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-8d5fa32c-3baf-43be-8f3c-81fc38e689ac tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:25.632836 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-8d5fa32c-3baf-43be-8f3c-81fc38e689ac tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:25.651455 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8d5fa32c-3baf-43be-8f3c-81fc38e689ac tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:25.653386 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8d5fa32c-3baf-43be-8f3c-81fc38e689ac tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:25.654382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8d5fa32c-3baf-43be-8f3c-81fc38e689ac tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:25.655389 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8d5fa32c-3baf-43be-8f3c-81fc38e689ac tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:25.673859 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-42714490-5eb7-4b7f-a61c-585c26e977a9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:25.684009 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-42714490-5eb7-4b7f-a61c-585c26e977a9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 82eccf63-469a-47ea-aab4-536d6210c066] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:25.693899 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-42714490-5eb7-4b7f-a61c-585c26e977a9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:25.697467 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-42714490-5eb7-4b7f-a61c-585c26e977a9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:25.698688 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-42714490-5eb7-4b7f-a61c-585c26e977a9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:25.700799 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-42714490-5eb7-4b7f-a61c-585c26e977a9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:25.760915 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-42714490-5eb7-4b7f-a61c-585c26e977a9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:25.761854 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-42714490-5eb7-4b7f-a61c-585c26e977a9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:25.762441 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.objects.instance [None req-42714490-5eb7-4b7f-a61c-585c26e977a9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lazy-loading 'fault' on Instance uuid 82eccf63-469a-47ea-aab4-536d6210c066 {{(pid=118319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 16:12:25.823964 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-42714490-5eb7-4b7f-a61c-585c26e977a9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:25.838481 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-42714490-5eb7-4b7f-a61c-585c26e977a9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066" status: 200 len: 1332 microversion: 2.1 time: 0.168402 Jul 05 16:12:25.839783 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 247/489] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:25 2022] GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066 => generated 1332 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:12:25.893864 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-8d5fa32c-3baf-43be-8f3c-81fc38e689ac tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:25.903604 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-8d5fa32c-3baf-43be-8f3c-81fc38e689ac tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:25.905050 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-8d5fa32c-3baf-43be-8f3c-81fc38e689ac tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:25.906428 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-8d5fa32c-3baf-43be-8f3c-81fc38e689ac tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1807 microversion: 2.20 time: 0.292106 Jul 05 16:12:25.929260 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 243/490] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:12:25 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1807 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:12:26.166320 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-dc894769-c1e9-4e26-9ba7-735d135671e8 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:26.167960 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-dc894769-c1e9-4e26-9ba7-735d135671e8 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 352bc2a1-37ac-4578-8931-9ccb50d45e55] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:26.178172 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-dc894769-c1e9-4e26-9ba7-735d135671e8 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:26.179764 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-dc894769-c1e9-4e26-9ba7-735d135671e8 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:26.180666 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-dc894769-c1e9-4e26-9ba7-735d135671e8 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:26.181272 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-dc894769-c1e9-4e26-9ba7-735d135671e8 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:26.219454 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-dc894769-c1e9-4e26-9ba7-735d135671e8 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:26.219938 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-dc894769-c1e9-4e26-9ba7-735d135671e8 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:26.220992 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.objects.instance [None req-dc894769-c1e9-4e26-9ba7-735d135671e8 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lazy-loading 'fault' on Instance uuid 352bc2a1-37ac-4578-8931-9ccb50d45e55 {{(pid=118319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 16:12:26.282352 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-dc894769-c1e9-4e26-9ba7-735d135671e8 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0cc3e3c4804237b78241cca28ca689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce6460ca0714dc98df6e69034242a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:26.293163 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-dc894769-c1e9-4e26-9ba7-735d135671e8 tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55" status: 200 len: 1304 microversion: 2.1 time: 0.134431 Jul 05 16:12:26.294024 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 248/491] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:26 2022] GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55 => generated 1304 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:26.855533 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-4e53dc5b-1c64-4685-a7ea-44635015b746 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:26.856157 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-4e53dc5b-1c64-4685-a7ea-44635015b746 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 82eccf63-469a-47ea-aab4-536d6210c066] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:26.868612 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4e53dc5b-1c64-4685-a7ea-44635015b746 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:26.869083 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4e53dc5b-1c64-4685-a7ea-44635015b746 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:26.869867 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4e53dc5b-1c64-4685-a7ea-44635015b746 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:26.870301 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4e53dc5b-1c64-4685-a7ea-44635015b746 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:26.891381 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-4e53dc5b-1c64-4685-a7ea-44635015b746 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] HTTP exception thrown: Instance 82eccf63-469a-47ea-aab4-536d6210c066 could not be found. Jul 05 16:12:26.893387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-4e53dc5b-1c64-4685-a7ea-44635015b746 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Request method failure captured: Jul 05 16:12:26.893387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066 HTTP/1.1 Jul 05 16:12:26.893387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:12:26.893387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:12:26.893387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:12:26.893387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:12:26.893387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:12:26.893387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:12:26.893387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:12:26.893387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:12:26.893387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIcG6oJHBbOiV-hRrdMXuy13iZZ6hvCfk-vTWz4vq2ula5Qwq5GKAKhC7pohxgL-mMXAkQ0I8c07z_L-klhBhC6mFKTl8PgxIghG2kxSHmXvGruMCHGJe1XXCXlDVgGJeXVlaQZZep4KSMSbhku1jx5l6fL00FOe6C27ag91K3fk98 Jul 05 16:12:26.893387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:12:26.893387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:12:26.893387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:12:26.893387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:12:26.893387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:12:26.893387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:12:26.893387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 42e6ad67dbf542528726c545872ac10c Jul 05 16:12:26.893387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:12:26.893387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:12:26.893387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:12:26.894999 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_42e6ad67dbf542528726c545872ac10c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:12:26.894999 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:12:26.894999 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 42e6ad67dbf542528726c545872ac10c Jul 05 16:12:26.894999 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:12:26.894999 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-AttachVolumeNegativeTest-547019280-project Jul 05 16:12:26.894999 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:12:26.894999 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:12:26.894999 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: 0c8512e7c1704fac9cc4fcfe3bf1f18b Jul 05 16:12:26.894999 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-AttachVolumeNegativeTest-547019280-project Jul 05 16:12:26.894999 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:12:26.894999 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance 82eccf63-469a-47ea-aab4-536d6210c066 could not be found. Jul 05 16:12:26.894999 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': '82eccf63-469a-47ea-aab4-536d6210c066'} Jul 05 16:12:26.895916 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:12:26.895916 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:12:26.895916 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:12:26.895916 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:12:26.895916 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:12:26.895916 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:12:26.895916 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:12:26.895916 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:12:26.895916 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:12:26.895916 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:12:26.895916 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82eccf63-469a-47ea-aab4-536d6210c066 could not be found. Jul 05 16:12:26.895916 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:12:26.895916 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:12:26.895916 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:12:26.895916 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:12:26.895916 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:12:26.895916 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:12:26.895916 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:12:26.895916 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:12:26.895916 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:12:26.897229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:12:26.897229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 16:12:26.897229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 16:12:26.897229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:12:26.897229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:12:26.897229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:12:26.897229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:12:26.897229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82eccf63-469a-47ea-aab4-536d6210c066 could not be found. Jul 05 16:12:26.897229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:12:26.897229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:12:26.897229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:12:26.897229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:12:26.897229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:12:26.897229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:12:26.897229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:12:26.897229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:12:26.897229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82eccf63-469a-47ea-aab4-536d6210c066 could not be found. Jul 05 16:12:26.897229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:12:26.899234 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-4e53dc5b-1c64-4685-a7ea-44635015b746 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Returning 404 to user: Instance 82eccf63-469a-47ea-aab4-536d6210c066 could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:12:26.900297 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-4e53dc5b-1c64-4685-a7ea-44635015b746 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066" status: 404 len: 111 microversion: 2.1 time: 0.048530 Jul 05 16:12:26.909678 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-ab05d205-0edf-4fda-af2f-a22f400a83ad tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '.version_select at 0x7f3087f0b5e0>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:26.913549 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 244/492] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:26 2022] GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 16:12:26.936434 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-60267cdf-5242-4863-9bc7-81db1053e4bf tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:26.937330 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-60267cdf-5242-4863-9bc7-81db1053e4bf tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:26.945395 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-60267cdf-5242-4863-9bc7-81db1053e4bf tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:26.945857 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-60267cdf-5242-4863-9bc7-81db1053e4bf tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:26.946644 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-60267cdf-5242-4863-9bc7-81db1053e4bf tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:26.947243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-60267cdf-5242-4863-9bc7-81db1053e4bf tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:27.019133 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-ab05d205-0edf-4fda-af2f-a22f400a83ad tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1345371644" status: 202 len: 0 microversion: 2.1 time: 0.113282 Jul 05 16:12:27.024323 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 249/493] 10.222.0.45 () {58 vars in 1220 bytes} [Tue Jul 5 16:12:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1345371644 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 16:12:27.150200 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-60267cdf-5242-4863-9bc7-81db1053e4bf tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:27.159433 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-60267cdf-5242-4863-9bc7-81db1053e4bf tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:27.160967 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-60267cdf-5242-4863-9bc7-81db1053e4bf tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:27.162134 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-60267cdf-5242-4863-9bc7-81db1053e4bf tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1807 microversion: 2.20 time: 0.230298 Jul 05 16:12:27.163192 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 245/494] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:12:26 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1807 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:12:27.314007 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-2fee2400-d895-4020-b28a-7db3293718fc tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:27.315270 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-2fee2400-d895-4020-b28a-7db3293718fc tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] [instance: 352bc2a1-37ac-4578-8931-9ccb50d45e55] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:27.322033 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2fee2400-d895-4020-b28a-7db3293718fc tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:27.322683 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2fee2400-d895-4020-b28a-7db3293718fc tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:27.323630 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2fee2400-d895-4020-b28a-7db3293718fc tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:27.324224 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2fee2400-d895-4020-b28a-7db3293718fc tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:27.338597 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.wsgi [None req-2fee2400-d895-4020-b28a-7db3293718fc tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] HTTP exception thrown: Instance 352bc2a1-37ac-4578-8931-9ccb50d45e55 could not be found. Jul 05 16:12:27.358301 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-2fee2400-d895-4020-b28a-7db3293718fc tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Request method failure captured: Jul 05 16:12:27.358301 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: request: GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55 HTTP/1.1 Jul 05 16:12:27.358301 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Accept: application/json Jul 05 16:12:27.358301 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Accept-Encoding: identity Jul 05 16:12:27.358301 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Connection: close Jul 05 16:12:27.358301 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Content-Length: 0 Jul 05 16:12:27.358301 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Content-Type: application/json Jul 05 16:12:27.358301 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Host: 10.222.0.45 Jul 05 16:12:27.358301 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Openstack-System-Scope: None Jul 05 16:12:27.358301 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: User-Agent: python-urllib3/1.26.9 Jul 05 16:12:27.358301 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Auth-Token: gAAAAABixGKtcdGsrX_tLennRdFCsIcZM1nr6h96BYRutHstnAOyu27fv29jQarkNO8C-3yQIlKS72lqumZAJeVUGgWJ7mQLv2C94X10a9mJLtcCIy4iP9vZaiKH3Y-fsM-VGYE2UFVHDRA--9r6Lzyqs3VtVyp0n7CLIO8GFx5JTrKFqPLwutk Jul 05 16:12:27.358301 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Domain-Id: None Jul 05 16:12:27.358301 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Domain-Name: None Jul 05 16:12:27.358301 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Identity-Status: Confirmed Jul 05 16:12:27.358301 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Is-Admin-Project: True Jul 05 16:12:27.358301 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Domain-Id: default Jul 05 16:12:27.358301 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Domain-Name: Default Jul 05 16:12:27.358301 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Id: dce6460ca0714dc98df6e69034242a7f Jul 05 16:12:27.358301 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Name: tempest-VolumesActionsTest-1910468147 Jul 05 16:12:27.358301 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Role: reader,member Jul 05 16:12:27.358301 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Roles: reader,member Jul 05 16:12:27.360226 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_dce6460ca0714dc98df6e69034242a7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/dce6460ca0714dc98df6e69034242a7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/dce6460ca0714dc98df6e69034242a7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/dce6460ca0714dc98df6e69034242a7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:12:27.360226 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Tenant: tempest-VolumesActionsTest-1910468147 Jul 05 16:12:27.360226 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Tenant-Id: dce6460ca0714dc98df6e69034242a7f Jul 05 16:12:27.360226 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Tenant-Name: tempest-VolumesActionsTest-1910468147 Jul 05 16:12:27.360226 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User: tempest-VolumesActionsTest-1910468147-project Jul 05 16:12:27.360226 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Domain-Id: default Jul 05 16:12:27.360226 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Domain-Name: Default Jul 05 16:12:27.360226 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Id: 6e0cc3e3c4804237b78241cca28ca689 Jul 05 16:12:27.360226 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Name: tempest-VolumesActionsTest-1910468147-project Jul 05 16:12:27.360226 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: method: > Jul 05 16:12:27.360226 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: exception: Instance 352bc2a1-37ac-4578-8931-9ccb50d45e55 could not be found. Jul 05 16:12:27.360226 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: action_args: {'id': '352bc2a1-37ac-4578-8931-9ccb50d45e55'} Jul 05 16:12:27.361040 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:12:27.361040 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:12:27.361040 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:12:27.361040 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:12:27.361040 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:12:27.361040 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:12:27.361040 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:12:27.361040 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:12:27.361040 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:12:27.361040 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:12:27.361040 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 352bc2a1-37ac-4578-8931-9ccb50d45e55 could not be found. Jul 05 16:12:27.361040 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:12:27.361040 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:12:27.361040 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:12:27.361040 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:12:27.361040 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:12:27.361040 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:12:27.361040 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:12:27.361040 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:12:27.361040 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:12:27.362399 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:12:27.362399 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 16:12:27.362399 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 16:12:27.362399 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:12:27.362399 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:12:27.362399 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:12:27.362399 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:12:27.362399 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 352bc2a1-37ac-4578-8931-9ccb50d45e55 could not be found. Jul 05 16:12:27.362399 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:12:27.362399 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:12:27.362399 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:12:27.362399 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:12:27.362399 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:12:27.362399 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:12:27.362399 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:12:27.362399 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:12:27.362399 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 352bc2a1-37ac-4578-8931-9ccb50d45e55 could not be found. Jul 05 16:12:27.362399 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:12:27.364733 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-2fee2400-d895-4020-b28a-7db3293718fc tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] Returning 404 to user: Instance 352bc2a1-37ac-4578-8931-9ccb50d45e55 could not be found. {{(pid=118319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:12:27.364733 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-2fee2400-d895-4020-b28a-7db3293718fc tempest-VolumesActionsTest-1910468147 tempest-VolumesActionsTest-1910468147-project] 10.222.0.45 "GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55" status: 404 len: 111 microversion: 2.1 time: 0.043051 Jul 05 16:12:27.364733 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 250/495] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:27 2022] GET /compute/v2.1/servers/352bc2a1-37ac-4578-8931-9ccb50d45e55 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 16:12:28.179500 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-00d684ac-3c16-468b-a8ea-b58970c8ddf8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:28.184946 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-00d684ac-3c16-468b-a8ea-b58970c8ddf8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:28.188167 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-00d684ac-3c16-468b-a8ea-b58970c8ddf8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:28.188619 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-00d684ac-3c16-468b-a8ea-b58970c8ddf8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:28.192635 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-00d684ac-3c16-468b-a8ea-b58970c8ddf8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:28.193117 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-00d684ac-3c16-468b-a8ea-b58970c8ddf8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:28.211966 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-d98e81c1-cd71-4050-95c2-544f33a48667 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:28.212477 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-d98e81c1-cd71-4050-95c2-544f33a48667 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:28.220481 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d98e81c1-cd71-4050-95c2-544f33a48667 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:28.220955 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d98e81c1-cd71-4050-95c2-544f33a48667 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:28.221728 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d98e81c1-cd71-4050-95c2-544f33a48667 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:28.222167 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d98e81c1-cd71-4050-95c2-544f33a48667 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:28.402061 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.objects.instance [None req-d98e81c1-cd71-4050-95c2-544f33a48667 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lazy-loading 'services' on Instance uuid 478dac11-75cf-4e58-9ba7-e78469b8045a {{(pid=118319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 16:12:28.408649 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-00d684ac-3c16-468b-a8ea-b58970c8ddf8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:28.415702 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-00d684ac-3c16-468b-a8ea-b58970c8ddf8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:28.417611 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-00d684ac-3c16-468b-a8ea-b58970c8ddf8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:28.418786 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-00d684ac-3c16-468b-a8ea-b58970c8ddf8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1794 microversion: 2.20 time: 0.243236 Jul 05 16:12:28.419330 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 246/496] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:12:28 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1794 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:12:28.682695 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-d98e81c1-cd71-4050-95c2-544f33a48667 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "DELETE /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a/os-volume_attachments/781b0d96-f540-40d0-bfe6-6478ffade503" status: 202 len: 0 microversion: 2.1 time: 0.474782 Jul 05 16:12:28.683606 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 251/497] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Jul 5 16:12:28 2022] DELETE /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a/os-volume_attachments/781b0d96-f540-40d0-bfe6-6478ffade503 => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 16:12:28.692187 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-b38486ab-6d19-4db6-aa76-31ef8aaf1057 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:28.693143 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-b38486ab-6d19-4db6-aa76-31ef8aaf1057 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:28.703633 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b38486ab-6d19-4db6-aa76-31ef8aaf1057 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:28.706374 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b38486ab-6d19-4db6-aa76-31ef8aaf1057 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:28.707979 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b38486ab-6d19-4db6-aa76-31ef8aaf1057 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:28.708606 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b38486ab-6d19-4db6-aa76-31ef8aaf1057 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:28.742877 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-b38486ab-6d19-4db6-aa76-31ef8aaf1057 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054734 Jul 05 16:12:28.744053 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 247/498] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Jul 5 16:12:28 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:12:29.762282 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-aa68bf8f-68f5-42dd-b399-20d7407480e3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:29.763355 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-aa68bf8f-68f5-42dd-b399-20d7407480e3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:29.777329 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-aa68bf8f-68f5-42dd-b399-20d7407480e3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:29.777769 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-aa68bf8f-68f5-42dd-b399-20d7407480e3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:29.778530 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-aa68bf8f-68f5-42dd-b399-20d7407480e3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:29.778961 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-aa68bf8f-68f5-42dd-b399-20d7407480e3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:29.807208 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-aa68bf8f-68f5-42dd-b399-20d7407480e3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055915 Jul 05 16:12:29.807759 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 252/499] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Jul 5 16:12:29 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:12:30.818803 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-dce09ee0-3f76-4cad-9622-6f6aa180dda9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:30.819740 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-dce09ee0-3f76-4cad-9622-6f6aa180dda9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:30.826297 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dce09ee0-3f76-4cad-9622-6f6aa180dda9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:30.826731 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dce09ee0-3f76-4cad-9622-6f6aa180dda9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:30.827498 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dce09ee0-3f76-4cad-9622-6f6aa180dda9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:30.827939 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dce09ee0-3f76-4cad-9622-6f6aa180dda9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:30.830473 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:30.858046 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-dce09ee0-3f76-4cad-9622-6f6aa180dda9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043202 Jul 05 16:12:30.858599 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 248/500] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Jul 5 16:12:30 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:12:30.931417 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-9cf89360-6cdc-4e7b-acb6-8685988141fe tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Action: 'create', calling method: .version_select at 0x7f3087fa8f70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1872870087", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9rAgN4WkI/aVmSvf0VzWxCh27LsRxQQKZIm2JD3eRj2V0XSnFbqLOuX2mV1/SvgE9Dn9SE+JrZdREKqziNlhXIaB7W4YabvBL2WrSeaz4V3GNSARxc0bOboy3RunFzOg=="}} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:12:30.945306 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.quota [None req-9cf89360-6cdc-4e7b-acb6-8685988141fe tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Getting quotas for project 71b68c04578747d08842aab556e98030. Resources: {'key_pairs'} {{(pid=118319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:12:30.949016 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.quota [None req-9cf89360-6cdc-4e7b-acb6-8685988141fe tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Getting quotas for user 80de40d2a02343858849d481590aa570 and project 71b68c04578747d08842aab556e98030. Resources: {'key_pairs'} {{(pid=118319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:12:31.077995 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-9cf89360-6cdc-4e7b-acb6-8685988141fe tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.150369 Jul 05 16:12:31.078790 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 253/501] 10.222.0.45 () {60 vars in 1158 bytes} [Tue Jul 5 16:12:30 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:12:31.126241 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-44487a39-14f8-4a40-bb3e-fec7e0a7a710 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1711469552", "imageRef": "c06e2aeb-cc66-4eef-aad0-839b523f20e6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1872870087", "networks": [{"uuid": "750c75bc-9396-4e63-887d-6375009b41b0"}]}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:12:31.177394 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.network.neutron [None req-44487a39-14f8-4a40-bb3e-fec7e0a7a710 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] validate_networks() for [('750c75bc-9396-4e63-887d-6375009b41b0', None, None, None, None, None)] {{(pid=118320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 16:12:31.537347 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-44487a39-14f8-4a40-bb3e-fec7e0a7a710 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Flavor limits 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 16:12:31.537813 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-44487a39-14f8-4a40-bb3e-fec7e0a7a710 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Image limits 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 16:12:31.538289 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-44487a39-14f8-4a40-bb3e-fec7e0a7a710 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Flavor pref 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 16:12:31.538701 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-44487a39-14f8-4a40-bb3e-fec7e0a7a710 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Image pref 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 16:12:31.539144 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-44487a39-14f8-4a40-bb3e-fec7e0a7a710 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 16:12:31.548010 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-44487a39-14f8-4a40-bb3e-fec7e0a7a710 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:31.548456 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-44487a39-14f8-4a40-bb3e-fec7e0a7a710 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:31.549293 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-44487a39-14f8-4a40-bb3e-fec7e0a7a710 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:31.549733 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-44487a39-14f8-4a40-bb3e-fec7e0a7a710 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:31.567393 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-44487a39-14f8-4a40-bb3e-fec7e0a7a710 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Getting quotas for project 71b68c04578747d08842aab556e98030. Resources: {'ram', 'instances', 'cores'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:12:31.571910 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-44487a39-14f8-4a40-bb3e-fec7e0a7a710 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Getting quotas for user 80de40d2a02343858849d481590aa570 and project 71b68c04578747d08842aab556e98030. Resources: {'ram', 'instances', 'cores'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:12:31.583261 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-44487a39-14f8-4a40-bb3e-fec7e0a7a710 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Going to run 1 instances... {{(pid=118320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 16:12:31.586531 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-44487a39-14f8-4a40-bb3e-fec7e0a7a710 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c06e2aeb-cc66-4eef-aad0-839b523f20e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 16:12:31.780814 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-44487a39-14f8-4a40-bb3e-fec7e0a7a710 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.658270 Jul 05 16:12:31.781388 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 249/502] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Jul 5 16:12:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 16:12:31.791778 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-961221ff-44f6-447f-b85a-eed53766c56d tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:31.792709 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-961221ff-44f6-447f-b85a-eed53766c56d tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:31.853695 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-961221ff-44f6-447f-b85a-eed53766c56d tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:31.861714 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-961221ff-44f6-447f-b85a-eed53766c56d tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1259 microversion: 2.1 time: 0.074393 Jul 05 16:12:31.862351 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 254/503] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:31 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1259 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:31.870436 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-b5d38fbb-66ab-4e4c-9934-538208452863 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:31.871487 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-b5d38fbb-66ab-4e4c-9934-538208452863 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:31.878167 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b5d38fbb-66ab-4e4c-9934-538208452863 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:31.878623 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b5d38fbb-66ab-4e4c-9934-538208452863 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:31.879397 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b5d38fbb-66ab-4e4c-9934-538208452863 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:31.879840 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b5d38fbb-66ab-4e4c-9934-538208452863 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:31.908934 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-b5d38fbb-66ab-4e4c-9934-538208452863 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043056 Jul 05 16:12:31.909507 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 250/504] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Jul 5 16:12:31 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:12:32.058073 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-c18eca5f-12a4-4751-8edc-1d39739ee44d tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:32.058578 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-c18eca5f-12a4-4751-8edc-1d39739ee44d tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:32.064948 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c18eca5f-12a4-4751-8edc-1d39739ee44d tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:32.065390 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c18eca5f-12a4-4751-8edc-1d39739ee44d tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:32.066145 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c18eca5f-12a4-4751-8edc-1d39739ee44d tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:32.066577 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c18eca5f-12a4-4751-8edc-1d39739ee44d tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:32.149422 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.objects.instance [None req-c18eca5f-12a4-4751-8edc-1d39739ee44d tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lazy-loading 'services' on Instance uuid 9b902cfe-0e0b-4ce5-b2df-67ca0464da74 {{(pid=118319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 16:12:32.373059 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-c18eca5f-12a4-4751-8edc-1d39739ee44d tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74/os-volume_attachments/f63b89f2-d118-438e-b267-d6980be57492" status: 202 len: 0 microversion: 2.1 time: 0.319643 Jul 05 16:12:32.373653 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 255/505] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Jul 5 16:12:32 2022] DELETE /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74/os-volume_attachments/f63b89f2-d118-438e-b267-d6980be57492 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 16:12:32.881052 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-5813b58c-d362-41d6-bedd-242e60dd942f tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:32.882324 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-5813b58c-d362-41d6-bedd-242e60dd942f tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:32.920497 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-3da0ba8a-fe86-43c4-b75b-43ba17e45237 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:32.921596 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-3da0ba8a-fe86-43c4-b75b-43ba17e45237 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:32.928600 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3da0ba8a-fe86-43c4-b75b-43ba17e45237 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:32.929194 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3da0ba8a-fe86-43c4-b75b-43ba17e45237 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:32.929956 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3da0ba8a-fe86-43c4-b75b-43ba17e45237 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:32.930387 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3da0ba8a-fe86-43c4-b75b-43ba17e45237 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:32.934791 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-5813b58c-d362-41d6-bedd-242e60dd942f tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:32.941717 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-5813b58c-d362-41d6-bedd-242e60dd942f tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1259 microversion: 2.1 time: 0.064678 Jul 05 16:12:32.942290 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 251/506] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:32 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1259 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:32.964842 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-3da0ba8a-fe86-43c4-b75b-43ba17e45237 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048130 Jul 05 16:12:32.968362 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 256/507] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Jul 5 16:12:32 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:12:33.497628 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-483b0388-d849-47a5-b5d5-c871bdcbf6fe tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:12:33.500531 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-483b0388-d849-47a5-b5d5-c871bdcbf6fe tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:33.510757 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-483b0388-d849-47a5-b5d5-c871bdcbf6fe tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:33.511476 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-483b0388-d849-47a5-b5d5-c871bdcbf6fe tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:33.512461 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-483b0388-d849-47a5-b5d5-c871bdcbf6fe tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:33.513109 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-483b0388-d849-47a5-b5d5-c871bdcbf6fe tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:33.541972 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.objects.instance [None req-483b0388-d849-47a5-b5d5-c871bdcbf6fe tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lazy-loading 'flavor' on Instance uuid 42be8657-fc50-4057-b373-e7bcf984e261 {{(pid=118320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 16:12:33.962019 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-cedec7d0-9bd5-4295-8d0e-b31fca330b28 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:33.963185 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-cedec7d0-9bd5-4295-8d0e-b31fca330b28 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:33.995023 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cedec7d0-9bd5-4295-8d0e-b31fca330b28 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:33.996032 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cedec7d0-9bd5-4295-8d0e-b31fca330b28 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:33.996980 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cedec7d0-9bd5-4295-8d0e-b31fca330b28 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:33.997841 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cedec7d0-9bd5-4295-8d0e-b31fca330b28 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:34.082709 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-483b0388-d849-47a5-b5d5-c871bdcbf6fe tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "POST /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261/action" status: 200 len: 32 microversion: 2.1 time: 0.588508 Jul 05 16:12:34.084759 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 252/508] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Jul 5 16:12:33 2022] POST /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261/action => generated 32 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 16:12:34.090848 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-b8a97c36-820a-426b-bf65-acd381717d31 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:34.092084 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-b8a97c36-820a-426b-bf65-acd381717d31 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:34.098641 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-cedec7d0-9bd5-4295-8d0e-b31fca330b28 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:34.099172 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b8a97c36-820a-426b-bf65-acd381717d31 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:34.099621 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b8a97c36-820a-426b-bf65-acd381717d31 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:34.101982 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b8a97c36-820a-426b-bf65-acd381717d31 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:34.102641 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b8a97c36-820a-426b-bf65-acd381717d31 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:34.111689 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-cedec7d0-9bd5-4295-8d0e-b31fca330b28 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1311 microversion: 2.1 time: 0.156341 Jul 05 16:12:34.112452 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 257/509] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:33 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1311 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:12:34.123434 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-d14fe379-82f5-4e89-a839-92d178a3dd5c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:34.123434 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-d14fe379-82f5-4e89-a839-92d178a3dd5c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:34.133964 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d14fe379-82f5-4e89-a839-92d178a3dd5c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:34.134776 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d14fe379-82f5-4e89-a839-92d178a3dd5c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:34.136381 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d14fe379-82f5-4e89-a839-92d178a3dd5c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:34.136517 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d14fe379-82f5-4e89-a839-92d178a3dd5c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:34.155551 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-b8a97c36-820a-426b-bf65-acd381717d31 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069363 Jul 05 16:12:34.156438 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 253/510] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Jul 5 16:12:34 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:12:34.288678 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-d14fe379-82f5-4e89-a839-92d178a3dd5c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:34.300380 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-d14fe379-82f5-4e89-a839-92d178a3dd5c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1734 microversion: 2.1 time: 0.186638 Jul 05 16:12:34.311899 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 258/511] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:34 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1734 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:35.131788 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-1b80d357-5e9a-4f19-bbe4-9a71c07532c0 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:35.132596 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-1b80d357-5e9a-4f19-bbe4-9a71c07532c0 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:35.142590 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1b80d357-5e9a-4f19-bbe4-9a71c07532c0 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:35.143345 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1b80d357-5e9a-4f19-bbe4-9a71c07532c0 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:35.144456 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1b80d357-5e9a-4f19-bbe4-9a71c07532c0 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:35.150652 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1b80d357-5e9a-4f19-bbe4-9a71c07532c0 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:35.166584 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-93f2862f-b8cb-4a3d-98ac-722881aad01a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:35.167962 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-93f2862f-b8cb-4a3d-98ac-722881aad01a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:35.183321 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-93f2862f-b8cb-4a3d-98ac-722881aad01a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:35.183780 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-93f2862f-b8cb-4a3d-98ac-722881aad01a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:35.184556 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-93f2862f-b8cb-4a3d-98ac-722881aad01a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:35.185031 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-93f2862f-b8cb-4a3d-98ac-722881aad01a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:35.253874 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-93f2862f-b8cb-4a3d-98ac-722881aad01a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085864 Jul 05 16:12:35.259620 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 259/512] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Jul 5 16:12:35 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 05 16:12:35.320414 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-06357912-8878-4f3d-b702-8ece6e8d8311 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:35.321064 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-06357912-8878-4f3d-b702-8ece6e8d8311 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:35.328467 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-06357912-8878-4f3d-b702-8ece6e8d8311 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:35.335218 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-06357912-8878-4f3d-b702-8ece6e8d8311 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:35.338647 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-06357912-8878-4f3d-b702-8ece6e8d8311 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:35.339857 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-06357912-8878-4f3d-b702-8ece6e8d8311 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:35.352656 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-1b80d357-5e9a-4f19-bbe4-9a71c07532c0 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:35.362879 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-1b80d357-5e9a-4f19-bbe4-9a71c07532c0 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1329 microversion: 2.1 time: 0.235864 Jul 05 16:12:35.365348 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 254/513] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:35 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1329 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:35.374357 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-a0c18342-22bb-421f-af19-0ef5f77dc2f3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:35.382217 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-a0c18342-22bb-421f-af19-0ef5f77dc2f3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:35.399168 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a0c18342-22bb-421f-af19-0ef5f77dc2f3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:35.402016 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a0c18342-22bb-421f-af19-0ef5f77dc2f3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:35.402016 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a0c18342-22bb-421f-af19-0ef5f77dc2f3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:35.402016 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a0c18342-22bb-421f-af19-0ef5f77dc2f3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:35.456809 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-a0c18342-22bb-421f-af19-0ef5f77dc2f3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Going to try to terminate instance {{(pid=118320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 16:12:35.665846 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-06357912-8878-4f3d-b702-8ece6e8d8311 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:35.679188 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-06357912-8878-4f3d-b702-8ece6e8d8311 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1734 microversion: 2.1 time: 0.362795 Jul 05 16:12:35.680869 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 260/514] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:35 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1734 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:35.720594 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-6d4d74a3-c5de-460c-b6be-0b38bc05e889 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:12:35.728455 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-6d4d74a3-c5de-460c-b6be-0b38bc05e889 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:35.729112 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-6d4d74a3-c5de-460c-b6be-0b38bc05e889 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:35.754659 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-6d4d74a3-c5de-460c-b6be-0b38bc05e889 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Going to try to stop instance {{(pid=118319) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 05 16:12:35.903184 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-a0c18342-22bb-421f-af19-0ef5f77dc2f3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "DELETE /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 204 len: 0 microversion: 2.1 time: 0.533422 Jul 05 16:12:35.903689 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 255/515] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Jul 5 16:12:35 2022] DELETE /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 16:12:35.913375 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-34ca7284-b453-42b5-b1d7-af37a7736742 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:35.914514 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-34ca7284-b453-42b5-b1d7-af37a7736742 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:35.921001 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-34ca7284-b453-42b5-b1d7-af37a7736742 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:35.921288 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-34ca7284-b453-42b5-b1d7-af37a7736742 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:35.922255 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-34ca7284-b453-42b5-b1d7-af37a7736742 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:35.922867 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-34ca7284-b453-42b5-b1d7-af37a7736742 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:35.968907 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-6d4d74a3-c5de-460c-b6be-0b38bc05e889 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "POST /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74/action" status: 202 len: 0 microversion: 2.1 time: 0.251885 Jul 05 16:12:35.970124 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 261/516] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Jul 5 16:12:35 2022] POST /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 16:12:35.979128 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-ba190a34-5647-4928-99a7-ccb64c80f718 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:35.980186 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-ba190a34-5647-4928-99a7-ccb64c80f718 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:35.987609 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ba190a34-5647-4928-99a7-ccb64c80f718 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:35.988533 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ba190a34-5647-4928-99a7-ccb64c80f718 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:35.989536 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ba190a34-5647-4928-99a7-ccb64c80f718 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:35.990139 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ba190a34-5647-4928-99a7-ccb64c80f718 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:36.391379 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-ba190a34-5647-4928-99a7-ccb64c80f718 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:36.400748 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-ba190a34-5647-4928-99a7-ccb64c80f718 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1675 microversion: 2.1 time: 0.426552 Jul 05 16:12:36.408199 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 262/517] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:35 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1675 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:36.413059 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-34ca7284-b453-42b5-b1d7-af37a7736742 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:36.414066 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-d0191ab7-bf55-44b2-8195-3b30b477a5b0 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:36.414873 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-d0191ab7-bf55-44b2-8195-3b30b477a5b0 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:36.429914 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-34ca7284-b453-42b5-b1d7-af37a7736742 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1681 microversion: 2.1 time: 0.521112 Jul 05 16:12:36.440522 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 256/518] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:35 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1681 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:12:36.445616 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d0191ab7-bf55-44b2-8195-3b30b477a5b0 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:36.446269 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d0191ab7-bf55-44b2-8195-3b30b477a5b0 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:36.448224 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d0191ab7-bf55-44b2-8195-3b30b477a5b0 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:36.448975 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d0191ab7-bf55-44b2-8195-3b30b477a5b0 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:36.455654 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:36.638513 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-d0191ab7-bf55-44b2-8195-3b30b477a5b0 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:36.649102 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-d0191ab7-bf55-44b2-8195-3b30b477a5b0 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1359 microversion: 2.1 time: 0.239363 Jul 05 16:12:36.649968 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 263/519] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:36 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:36.697739 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-5f3025ff-9b5d-407f-bad5-fdc9e62396e3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:36.698353 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-5f3025ff-9b5d-407f-bad5-fdc9e62396e3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:36.704649 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5f3025ff-9b5d-407f-bad5-fdc9e62396e3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:36.705175 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5f3025ff-9b5d-407f-bad5-fdc9e62396e3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:36.705940 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5f3025ff-9b5d-407f-bad5-fdc9e62396e3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:36.706570 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5f3025ff-9b5d-407f-bad5-fdc9e62396e3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:36.860127 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-5f3025ff-9b5d-407f-bad5-fdc9e62396e3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:36.869468 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-5f3025ff-9b5d-407f-bad5-fdc9e62396e3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1734 microversion: 2.1 time: 0.176402 Jul 05 16:12:36.871656 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 257/520] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:36 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:37.434719 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-42e546a0-4403-49e7-ab50-3f9156b287ba tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:37.435628 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-42e546a0-4403-49e7-ab50-3f9156b287ba tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:37.444921 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-42e546a0-4403-49e7-ab50-3f9156b287ba tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:37.450525 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-49896a32-8f98-43e9-85c1-7aca27c15312 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:37.452584 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-49896a32-8f98-43e9-85c1-7aca27c15312 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:37.456226 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-42e546a0-4403-49e7-ab50-3f9156b287ba tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:37.457583 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-42e546a0-4403-49e7-ab50-3f9156b287ba tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:37.458241 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-42e546a0-4403-49e7-ab50-3f9156b287ba tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:37.470063 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-49896a32-8f98-43e9-85c1-7aca27c15312 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:37.470617 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-49896a32-8f98-43e9-85c1-7aca27c15312 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:37.471554 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-49896a32-8f98-43e9-85c1-7aca27c15312 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:37.477111 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-49896a32-8f98-43e9-85c1-7aca27c15312 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:37.745591 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-49896a32-8f98-43e9-85c1-7aca27c15312 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:37.754400 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-49896a32-8f98-43e9-85c1-7aca27c15312 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1681 microversion: 2.1 time: 0.310065 Jul 05 16:12:37.755244 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 258/521] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:37 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1681 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:37.762063 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-42e546a0-4403-49e7-ab50-3f9156b287ba tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:37.775480 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-3d44c8ce-22ca-4df9-9d2f-260b6d4c4962 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:37.776325 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-42e546a0-4403-49e7-ab50-3f9156b287ba tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1675 microversion: 2.1 time: 0.345528 Jul 05 16:12:37.787129 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 264/522] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:37 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1675 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:37.788241 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-3d44c8ce-22ca-4df9-9d2f-260b6d4c4962 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:37.802747 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3d44c8ce-22ca-4df9-9d2f-260b6d4c4962 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:37.805757 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3d44c8ce-22ca-4df9-9d2f-260b6d4c4962 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:37.806858 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3d44c8ce-22ca-4df9-9d2f-260b6d4c4962 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:37.807606 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3d44c8ce-22ca-4df9-9d2f-260b6d4c4962 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:37.887581 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-06e0611b-6334-4334-bf36-33ef378dce50 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:37.888672 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-06e0611b-6334-4334-bf36-33ef378dce50 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:37.898412 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-06e0611b-6334-4334-bf36-33ef378dce50 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:37.901537 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-06e0611b-6334-4334-bf36-33ef378dce50 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:37.903386 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-06e0611b-6334-4334-bf36-33ef378dce50 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:37.904519 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-06e0611b-6334-4334-bf36-33ef378dce50 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:38.074571 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-3d44c8ce-22ca-4df9-9d2f-260b6d4c4962 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:38.082746 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-3d44c8ce-22ca-4df9-9d2f-260b6d4c4962 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1359 microversion: 2.1 time: 0.326243 Jul 05 16:12:38.095834 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 259/523] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:37 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1359 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:38.185363 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-06e0611b-6334-4334-bf36-33ef378dce50 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:38.195684 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-06e0611b-6334-4334-bf36-33ef378dce50 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1734 microversion: 2.1 time: 0.311900 Jul 05 16:12:38.196388 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 265/524] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:37 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1734 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:38.774554 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-524882fd-b578-4bbc-a813-338125b9b5ad tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:38.775187 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-524882fd-b578-4bbc-a813-338125b9b5ad tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:38.789991 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-524882fd-b578-4bbc-a813-338125b9b5ad tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:38.790444 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-524882fd-b578-4bbc-a813-338125b9b5ad tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:38.791214 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-524882fd-b578-4bbc-a813-338125b9b5ad tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:38.791658 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-524882fd-b578-4bbc-a813-338125b9b5ad tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:38.795168 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-ecc9d170-a3e9-461a-93a7-f7d7cf55a63b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:38.795845 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-ecc9d170-a3e9-461a-93a7-f7d7cf55a63b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:38.815642 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ecc9d170-a3e9-461a-93a7-f7d7cf55a63b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:38.816559 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ecc9d170-a3e9-461a-93a7-f7d7cf55a63b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:38.818074 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ecc9d170-a3e9-461a-93a7-f7d7cf55a63b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:38.818926 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ecc9d170-a3e9-461a-93a7-f7d7cf55a63b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:39.239136 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-524882fd-b578-4bbc-a813-338125b9b5ad tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:39.255851 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-ecc9d170-a3e9-461a-93a7-f7d7cf55a63b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:39.263277 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-524882fd-b578-4bbc-a813-338125b9b5ad tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1681 microversion: 2.1 time: 0.492668 Jul 05 16:12:39.268302 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-ecc9d170-a3e9-461a-93a7-f7d7cf55a63b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1675 microversion: 2.1 time: 0.477501 Jul 05 16:12:39.269196 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 260/525] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:38 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1681 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:39.272154 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 266/526] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:38 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1675 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:39.277226 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-dc728407-1f06-42c5-ae92-04c5e068b107 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:39.281228 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-a5202d99-2415-4e3e-8797-67581c92f521 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:39.285647 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-dc728407-1f06-42c5-ae92-04c5e068b107 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:39.288516 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-a5202d99-2415-4e3e-8797-67581c92f521 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:39.306040 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a5202d99-2415-4e3e-8797-67581c92f521 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:39.307363 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:39.309211 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dc728407-1f06-42c5-ae92-04c5e068b107 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:39.311578 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dc728407-1f06-42c5-ae92-04c5e068b107 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:39.312592 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dc728407-1f06-42c5-ae92-04c5e068b107 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:39.313412 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a5202d99-2415-4e3e-8797-67581c92f521 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:39.316205 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dc728407-1f06-42c5-ae92-04c5e068b107 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:39.321904 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a5202d99-2415-4e3e-8797-67581c92f521 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:39.322648 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a5202d99-2415-4e3e-8797-67581c92f521 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:39.746616 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-dc728407-1f06-42c5-ae92-04c5e068b107 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:39.754771 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-dc728407-1f06-42c5-ae92-04c5e068b107 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1359 microversion: 2.1 time: 0.484222 Jul 05 16:12:39.756015 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 261/527] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:39 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1359 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:39.793677 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-a5202d99-2415-4e3e-8797-67581c92f521 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:39.803845 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-a5202d99-2415-4e3e-8797-67581c92f521 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1734 microversion: 2.1 time: 0.530323 Jul 05 16:12:39.824300 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 267/528] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:39 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1734 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:40.305133 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-d4502675-4722-4adb-a11e-29a5b160f3dc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:40.305858 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-d4502675-4722-4adb-a11e-29a5b160f3dc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:40.306745 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-63bbb382-3111-4881-bf83-cdf54f6d2694 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:40.307360 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-63bbb382-3111-4881-bf83-cdf54f6d2694 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:40.312405 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d4502675-4722-4adb-a11e-29a5b160f3dc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:40.312893 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d4502675-4722-4adb-a11e-29a5b160f3dc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:40.313678 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d4502675-4722-4adb-a11e-29a5b160f3dc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:40.314076 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-63bbb382-3111-4881-bf83-cdf54f6d2694 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:40.314191 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d4502675-4722-4adb-a11e-29a5b160f3dc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:40.314518 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-63bbb382-3111-4881-bf83-cdf54f6d2694 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:40.315282 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-63bbb382-3111-4881-bf83-cdf54f6d2694 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:40.315712 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-63bbb382-3111-4881-bf83-cdf54f6d2694 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:40.570926 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-d4502675-4722-4adb-a11e-29a5b160f3dc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:40.577758 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:40.590276 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-d4502675-4722-4adb-a11e-29a5b160f3dc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1681 microversion: 2.1 time: 0.288012 Jul 05 16:12:40.591517 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 262/529] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:40 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1681 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:40.644940 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-63bbb382-3111-4881-bf83-cdf54f6d2694 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:40.653076 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-63bbb382-3111-4881-bf83-cdf54f6d2694 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1675 microversion: 2.1 time: 0.349762 Jul 05 16:12:40.671296 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 268/530] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:40 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1675 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:12:40.777954 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-32320dfd-6bd7-4bed-960e-822cf9b3bd2e tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:40.778786 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-32320dfd-6bd7-4bed-960e-822cf9b3bd2e tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:40.790407 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-32320dfd-6bd7-4bed-960e-822cf9b3bd2e tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:40.792965 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-32320dfd-6bd7-4bed-960e-822cf9b3bd2e tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:40.795074 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-32320dfd-6bd7-4bed-960e-822cf9b3bd2e tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:40.797618 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-32320dfd-6bd7-4bed-960e-822cf9b3bd2e tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:40.822444 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-e6505ce5-e13c-4e39-af6b-429f64525b7b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:40.826616 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-e6505ce5-e13c-4e39-af6b-429f64525b7b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:40.840837 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e6505ce5-e13c-4e39-af6b-429f64525b7b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:40.841758 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e6505ce5-e13c-4e39-af6b-429f64525b7b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:40.842825 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e6505ce5-e13c-4e39-af6b-429f64525b7b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:40.843425 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e6505ce5-e13c-4e39-af6b-429f64525b7b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:41.244692 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-e6505ce5-e13c-4e39-af6b-429f64525b7b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:41.262566 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-e6505ce5-e13c-4e39-af6b-429f64525b7b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1734 microversion: 2.1 time: 0.444887 Jul 05 16:12:41.266195 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 269/531] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:40 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1734 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:12:41.284002 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-32320dfd-6bd7-4bed-960e-822cf9b3bd2e tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:41.304180 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-32320dfd-6bd7-4bed-960e-822cf9b3bd2e tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1359 microversion: 2.1 time: 0.532576 Jul 05 16:12:41.306360 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 263/532] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:40 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1359 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:41.502619 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [req-22ca528a-9307-4b95-8108-ce79387ae0b8 req-ebb6e6a0-bc7a-436f-914f-e0c2e739bf46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7e85e1f-39bb-4c8c-addb-85ae261a3eb7", "tag": "0acdc586-b1e0-458b-8b41-006c61e42c40"}]} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:12:41.511685 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:41.535815 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-22ca528a-9307-4b95-8108-ce79387ae0b8 req-ebb6e6a0-bc7a-436f-914f-e0c2e739bf46 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:41.536268 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-22ca528a-9307-4b95-8108-ce79387ae0b8 req-ebb6e6a0-bc7a-436f-914f-e0c2e739bf46 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:41.575079 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.compute.server_external_events [req-22ca528a-9307-4b95-8108-ce79387ae0b8 req-ebb6e6a0-bc7a-436f-914f-e0c2e739bf46 service nova] Creating event network-changed:0acdc586-b1e0-458b-8b41-006c61e42c40 for instance e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 on hv-cinder-84875 Jul 05 16:12:41.592797 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [req-22ca528a-9307-4b95-8108-ce79387ae0b8 req-ebb6e6a0-bc7a-436f-914f-e0c2e739bf46 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094696 Jul 05 16:12:41.595746 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 270/533] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:12:41.607847 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-26e7b478-4e58-4ea7-904c-8344fa77a76c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:41.608904 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-26e7b478-4e58-4ea7-904c-8344fa77a76c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:41.643080 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell0:SELECT=2 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:41.649821 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-26e7b478-4e58-4ea7-904c-8344fa77a76c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:41.652749 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-26e7b478-4e58-4ea7-904c-8344fa77a76c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:41.654514 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-26e7b478-4e58-4ea7-904c-8344fa77a76c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:41.655709 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-26e7b478-4e58-4ea7-904c-8344fa77a76c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:41.675421 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-e51d290c-69bd-47d1-a608-914786ee4a01 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:41.676134 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-e51d290c-69bd-47d1-a608-914786ee4a01 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:41.717290 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e51d290c-69bd-47d1-a608-914786ee4a01 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:41.717901 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e51d290c-69bd-47d1-a608-914786ee4a01 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:41.720901 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e51d290c-69bd-47d1-a608-914786ee4a01 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:41.721646 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e51d290c-69bd-47d1-a608-914786ee4a01 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:41.857772 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell0:SELECT=6 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:41.898396 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-26e7b478-4e58-4ea7-904c-8344fa77a76c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:41.926376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-26e7b478-4e58-4ea7-904c-8344fa77a76c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1613 microversion: 2.1 time: 0.320372 Jul 05 16:12:41.932740 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 264/534] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:41 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1613 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:41.947585 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-8ca2d16a-13bf-47b6-a8aa-e8b5d8371f8e req-d3b5aec2-c406-4449-a92f-d62ffa744292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "478dac11-75cf-4e58-9ba7-e78469b8045a", "name": "network-vif-deleted", "tag": "0d4a05ab-6ac5-4ab2-bad3-8b10a8823738"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:12:41.971013 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-8ca2d16a-13bf-47b6-a8aa-e8b5d8371f8e req-d3b5aec2-c406-4449-a92f-d62ffa744292 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:41.974792 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-8ca2d16a-13bf-47b6-a8aa-e8b5d8371f8e req-d3b5aec2-c406-4449-a92f-d62ffa744292 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:42.020209 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-8ca2d16a-13bf-47b6-a8aa-e8b5d8371f8e req-d3b5aec2-c406-4449-a92f-d62ffa744292 service nova] Creating event network-vif-deleted:0d4a05ab-6ac5-4ab2-bad3-8b10a8823738 for instance 478dac11-75cf-4e58-9ba7-e78469b8045a on hv-cinder-84875 Jul 05 16:12:42.035890 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-8ca2d16a-13bf-47b6-a8aa-e8b5d8371f8e req-d3b5aec2-c406-4449-a92f-d62ffa744292 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100131 Jul 05 16:12:42.037051 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 265/535] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:12:42.263739 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-e51d290c-69bd-47d1-a608-914786ee4a01 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:42.280918 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-e51d290c-69bd-47d1-a608-914786ee4a01 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1675 microversion: 2.1 time: 0.614660 Jul 05 16:12:42.282135 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 271/536] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:41 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1675 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:12:42.294741 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-4b173523-0fb3-41f1-b00e-2244d80a3a77 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:42.298866 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-4b173523-0fb3-41f1-b00e-2244d80a3a77 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:42.310489 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4b173523-0fb3-41f1-b00e-2244d80a3a77 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:42.311152 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4b173523-0fb3-41f1-b00e-2244d80a3a77 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:42.321381 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4b173523-0fb3-41f1-b00e-2244d80a3a77 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:42.325739 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4b173523-0fb3-41f1-b00e-2244d80a3a77 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:42.330393 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-9df37854-3b0f-470a-86c6-585b2bcd14e2 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:42.331082 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-9df37854-3b0f-470a-86c6-585b2bcd14e2 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:42.341152 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9df37854-3b0f-470a-86c6-585b2bcd14e2 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:42.341622 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9df37854-3b0f-470a-86c6-585b2bcd14e2 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:42.342409 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9df37854-3b0f-470a-86c6-585b2bcd14e2 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:42.342847 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9df37854-3b0f-470a-86c6-585b2bcd14e2 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:42.660039 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-9df37854-3b0f-470a-86c6-585b2bcd14e2 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:42.672141 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-9df37854-3b0f-470a-86c6-585b2bcd14e2 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1359 microversion: 2.1 time: 0.346295 Jul 05 16:12:42.685563 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 272/537] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:42 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1359 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:12:42.939102 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell0:SELECT=8 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:42.951778 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-d8ab437e-33bc-4e2a-91ed-2276944afc2d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:42.953063 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-d8ab437e-33bc-4e2a-91ed-2276944afc2d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:42.963317 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d8ab437e-33bc-4e2a-91ed-2276944afc2d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:42.964019 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d8ab437e-33bc-4e2a-91ed-2276944afc2d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:42.970578 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d8ab437e-33bc-4e2a-91ed-2276944afc2d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:42.971614 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d8ab437e-33bc-4e2a-91ed-2276944afc2d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:43.057769 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d8ab437e-33bc-4e2a-91ed-2276944afc2d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:43.060728 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d8ab437e-33bc-4e2a-91ed-2276944afc2d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:43.061406 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.objects.instance [None req-d8ab437e-33bc-4e2a-91ed-2276944afc2d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lazy-loading 'fault' on Instance uuid 478dac11-75cf-4e58-9ba7-e78469b8045a {{(pid=118319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 16:12:43.242428 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-4b173523-0fb3-41f1-b00e-2244d80a3a77 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:43.247853 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-d8ab437e-33bc-4e2a-91ed-2276944afc2d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:43.250205 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-d8ab437e-33bc-4e2a-91ed-2276944afc2d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 200 len: 1331 microversion: 2.1 time: 0.303668 Jul 05 16:12:43.257406 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-4b173523-0fb3-41f1-b00e-2244d80a3a77 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1734 microversion: 2.1 time: 0.977331 Jul 05 16:12:43.263638 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 273/538] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:42 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 1331 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:43.266059 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 266/539] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:42 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1734 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:43.301757 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-cd611ebb-f38e-4b34-b4af-854b6a16d0eb tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:43.302664 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-cd611ebb-f38e-4b34-b4af-854b6a16d0eb tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:43.311686 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cd611ebb-f38e-4b34-b4af-854b6a16d0eb tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:43.312464 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cd611ebb-f38e-4b34-b4af-854b6a16d0eb tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:43.315626 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cd611ebb-f38e-4b34-b4af-854b6a16d0eb tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:43.320997 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cd611ebb-f38e-4b34-b4af-854b6a16d0eb tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:43.679296 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-cd611ebb-f38e-4b34-b4af-854b6a16d0eb tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:43.687777 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-cd611ebb-f38e-4b34-b4af-854b6a16d0eb tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1675 microversion: 2.1 time: 0.392144 Jul 05 16:12:43.698111 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 274/540] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:43 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1675 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:43.702680 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-a38f3a34-71db-4c96-bc1c-5a7bd240cfe8 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:43.703314 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-a38f3a34-71db-4c96-bc1c-5a7bd240cfe8 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:43.715152 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a38f3a34-71db-4c96-bc1c-5a7bd240cfe8 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:43.722689 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a38f3a34-71db-4c96-bc1c-5a7bd240cfe8 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:43.725992 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a38f3a34-71db-4c96-bc1c-5a7bd240cfe8 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:43.726597 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a38f3a34-71db-4c96-bc1c-5a7bd240cfe8 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:44.024332 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-a38f3a34-71db-4c96-bc1c-5a7bd240cfe8 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:44.032628 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-a38f3a34-71db-4c96-bc1c-5a7bd240cfe8 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1359 microversion: 2.1 time: 0.333942 Jul 05 16:12:44.033446 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 267/541] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:43 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1359 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:44.275812 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-8e26d5f8-bf4a-44a1-9ab2-f29d8d14d364 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:44.284432 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-b8f70067-95c8-43ba-88b3-9b3da4a61967 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:44.285354 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-b8f70067-95c8-43ba-88b3-9b3da4a61967 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:44.287495 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-8e26d5f8-bf4a-44a1-9ab2-f29d8d14d364 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:44.310137 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b8f70067-95c8-43ba-88b3-9b3da4a61967 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:44.310693 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b8f70067-95c8-43ba-88b3-9b3da4a61967 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:44.311220 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8e26d5f8-bf4a-44a1-9ab2-f29d8d14d364 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:44.311760 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8e26d5f8-bf4a-44a1-9ab2-f29d8d14d364 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:44.312259 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b8f70067-95c8-43ba-88b3-9b3da4a61967 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:44.312814 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8e26d5f8-bf4a-44a1-9ab2-f29d8d14d364 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:44.313134 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b8f70067-95c8-43ba-88b3-9b3da4a61967 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:44.313979 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8e26d5f8-bf4a-44a1-9ab2-f29d8d14d364 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:44.345583 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.wsgi [None req-8e26d5f8-bf4a-44a1-9ab2-f29d8d14d364 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] HTTP exception thrown: Instance 478dac11-75cf-4e58-9ba7-e78469b8045a could not be found. Jul 05 16:12:44.347682 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-8e26d5f8-bf4a-44a1-9ab2-f29d8d14d364 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Request method failure captured: Jul 05 16:12:44.347682 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: request: GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a HTTP/1.1 Jul 05 16:12:44.347682 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Accept: application/json Jul 05 16:12:44.347682 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Accept-Encoding: identity Jul 05 16:12:44.347682 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Connection: close Jul 05 16:12:44.347682 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Content-Length: 0 Jul 05 16:12:44.347682 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Content-Type: application/json Jul 05 16:12:44.347682 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Host: 10.222.0.45 Jul 05 16:12:44.347682 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Openstack-System-Scope: None Jul 05 16:12:44.347682 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: User-Agent: python-urllib3/1.26.9 Jul 05 16:12:44.347682 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Auth-Token: gAAAAABixGIcG6oJHBbOiV-hRrdMXuy13iZZ6hvCfk-vTWz4vq2ula5Qwq5GKAKhC7pohxgL-mMXAkQ0I8c07z_L-klhBhC6mFKTl8PgxIghG2kxSHmXvGruMCHGJe1XXCXlDVgGJeXVlaQZZep4KSMSbhku1jx5l6fL00FOe6C27ag91K3fk98 Jul 05 16:12:44.347682 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Domain-Id: None Jul 05 16:12:44.347682 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Domain-Name: None Jul 05 16:12:44.347682 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Identity-Status: Confirmed Jul 05 16:12:44.347682 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Is-Admin-Project: True Jul 05 16:12:44.347682 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Domain-Id: default Jul 05 16:12:44.347682 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Domain-Name: Default Jul 05 16:12:44.347682 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Id: 42e6ad67dbf542528726c545872ac10c Jul 05 16:12:44.347682 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Name: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:12:44.347682 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Role: reader,member Jul 05 16:12:44.347682 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Roles: reader,member Jul 05 16:12:44.349297 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_42e6ad67dbf542528726c545872ac10c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:12:44.349297 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Tenant: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:12:44.349297 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Tenant-Id: 42e6ad67dbf542528726c545872ac10c Jul 05 16:12:44.349297 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:12:44.349297 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User: tempest-AttachVolumeNegativeTest-547019280-project Jul 05 16:12:44.349297 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Domain-Id: default Jul 05 16:12:44.349297 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Domain-Name: Default Jul 05 16:12:44.349297 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Id: 0c8512e7c1704fac9cc4fcfe3bf1f18b Jul 05 16:12:44.349297 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Name: tempest-AttachVolumeNegativeTest-547019280-project Jul 05 16:12:44.349297 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: method: > Jul 05 16:12:44.349297 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: exception: Instance 478dac11-75cf-4e58-9ba7-e78469b8045a could not be found. Jul 05 16:12:44.349297 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: action_args: {'id': '478dac11-75cf-4e58-9ba7-e78469b8045a'} Jul 05 16:12:44.353719 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:12:44.353719 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:12:44.353719 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:12:44.353719 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:12:44.353719 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:12:44.353719 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:12:44.353719 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:12:44.353719 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:12:44.353719 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:12:44.353719 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:12:44.353719 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 478dac11-75cf-4e58-9ba7-e78469b8045a could not be found. Jul 05 16:12:44.353719 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:12:44.353719 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:12:44.353719 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:12:44.353719 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:12:44.353719 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:12:44.353719 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:12:44.353719 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:12:44.353719 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:12:44.353719 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:12:44.410579 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:12:44.410579 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 16:12:44.410579 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 16:12:44.410579 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:12:44.410579 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:12:44.410579 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:12:44.410579 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:12:44.410579 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 478dac11-75cf-4e58-9ba7-e78469b8045a could not be found. Jul 05 16:12:44.410579 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:12:44.410579 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:12:44.410579 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:12:44.410579 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:12:44.410579 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:12:44.410579 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:12:44.410579 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:12:44.410579 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:12:44.410579 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 478dac11-75cf-4e58-9ba7-e78469b8045a could not be found. Jul 05 16:12:44.410579 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:12:44.411671 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-8e26d5f8-bf4a-44a1-9ab2-f29d8d14d364 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Returning 404 to user: Instance 478dac11-75cf-4e58-9ba7-e78469b8045a could not be found. {{(pid=118319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:12:44.411671 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-8e26d5f8-bf4a-44a1-9ab2-f29d8d14d364 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 404 len: 111 microversion: 2.1 time: 0.081573 Jul 05 16:12:44.411671 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 275/542] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:44 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 16:12:44.411671 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-21cdfd0c-639a-4789-ae74-41a2fc914368 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '.version_select at 0x7f3087f5e700>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:44.531096 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-b8f70067-95c8-43ba-88b3-9b3da4a61967 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:44.542259 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-b8f70067-95c8-43ba-88b3-9b3da4a61967 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1734 microversion: 2.1 time: 0.262660 Jul 05 16:12:44.543269 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 268/543] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:44 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1734 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:44.705637 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-23ca5b2a-eebb-454a-b001-9d77bec719a4 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:44.706349 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-23ca5b2a-eebb-454a-b001-9d77bec719a4 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:44.712677 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-23ca5b2a-eebb-454a-b001-9d77bec719a4 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:44.713166 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-23ca5b2a-eebb-454a-b001-9d77bec719a4 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:44.713937 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-23ca5b2a-eebb-454a-b001-9d77bec719a4 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:44.714372 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-23ca5b2a-eebb-454a-b001-9d77bec719a4 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:44.817912 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-21cdfd0c-639a-4789-ae74-41a2fc914368 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1131890633" status: 202 len: 0 microversion: 2.1 time: 0.462579 Jul 05 16:12:44.821851 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 276/544] 10.222.0.45 () {58 vars in 1220 bytes} [Tue Jul 5 16:12:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1131890633 => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 05 16:12:44.936560 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-23ca5b2a-eebb-454a-b001-9d77bec719a4 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:44.946235 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-23ca5b2a-eebb-454a-b001-9d77bec719a4 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1675 microversion: 2.1 time: 0.244199 Jul 05 16:12:44.948228 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 269/545] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:44 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1675 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:45.050101 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-4f14b69d-cfdf-482d-a533-f11cc9bc96ce tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:45.050859 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-4f14b69d-cfdf-482d-a533-f11cc9bc96ce tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:45.063038 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-4f14b69d-cfdf-482d-a533-f11cc9bc96ce tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:45.063891 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-4f14b69d-cfdf-482d-a533-f11cc9bc96ce tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:45.064952 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-4f14b69d-cfdf-482d-a533-f11cc9bc96ce tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:45.065940 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-4f14b69d-cfdf-482d-a533-f11cc9bc96ce tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:45.321460 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-4f14b69d-cfdf-482d-a533-f11cc9bc96ce tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:45.330414 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-4f14b69d-cfdf-482d-a533-f11cc9bc96ce tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1359 microversion: 2.1 time: 0.284444 Jul 05 16:12:45.333496 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 277/546] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:45 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1359 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:45.562567 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-edee52d7-d2f0-475f-88f4-5bfceeb86598 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:45.563417 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-edee52d7-d2f0-475f-88f4-5bfceeb86598 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:45.577249 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-edee52d7-d2f0-475f-88f4-5bfceeb86598 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:45.577652 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-edee52d7-d2f0-475f-88f4-5bfceeb86598 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:45.578494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-edee52d7-d2f0-475f-88f4-5bfceeb86598 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:45.578941 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-edee52d7-d2f0-475f-88f4-5bfceeb86598 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:45.811658 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-edee52d7-d2f0-475f-88f4-5bfceeb86598 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:45.822842 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-edee52d7-d2f0-475f-88f4-5bfceeb86598 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1734 microversion: 2.1 time: 0.264250 Jul 05 16:12:45.824237 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 270/547] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:45 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1734 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:45.972095 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-383079fd-a9d5-4d89-a287-398736cadb83 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:45.973749 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-383079fd-a9d5-4d89-a287-398736cadb83 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:45.993314 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-383079fd-a9d5-4d89-a287-398736cadb83 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:45.994595 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-383079fd-a9d5-4d89-a287-398736cadb83 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:45.999628 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-383079fd-a9d5-4d89-a287-398736cadb83 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:46.000888 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-383079fd-a9d5-4d89-a287-398736cadb83 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:46.024865 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-91d7b56d-db3b-4a01-9f10-72a6f5d77ae5 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Action: 'create', calling method: .version_select at 0x7f3087ea41f0>, body: {"keypair": {"name": "tempest-keypair-2084398981", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKC19N3/y5uyyR9LfcffmXeYq6z4ywq9pzIptJdtyoUmJYY3ooH197cid0rzHBByg1XBd9wlklq5jsbVEkjEJso6vr9ETVFb3o11gRNPGlWUFc8Zu9npJfcgOX6LYYhnBQ=="}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:12:46.042836 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-91d7b56d-db3b-4a01-9f10-72a6f5d77ae5 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Getting quotas for project 42e6ad67dbf542528726c545872ac10c. Resources: {'key_pairs'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:12:46.047440 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-91d7b56d-db3b-4a01-9f10-72a6f5d77ae5 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Getting quotas for user 0c8512e7c1704fac9cc4fcfe3bf1f18b and project 42e6ad67dbf542528726c545872ac10c. Resources: {'key_pairs'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:12:46.190096 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-91d7b56d-db3b-4a01-9f10-72a6f5d77ae5 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.169225 Jul 05 16:12:46.191281 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 271/548] 10.222.0.45 () {60 vars in 1158 bytes} [Tue Jul 5 16:12:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:12:46.225949 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-383079fd-a9d5-4d89-a287-398736cadb83 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:46.238836 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-383079fd-a9d5-4d89-a287-398736cadb83 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1675 microversion: 2.1 time: 0.274482 Jul 05 16:12:46.254264 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 278/549] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:45 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1675 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:46.350652 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-2e18ae47-b0f8-42ff-af0d-303cf8257f2f tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:46.351594 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-2e18ae47-b0f8-42ff-af0d-303cf8257f2f tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:46.372731 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2e18ae47-b0f8-42ff-af0d-303cf8257f2f tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:46.372731 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2e18ae47-b0f8-42ff-af0d-303cf8257f2f tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:46.372731 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2e18ae47-b0f8-42ff-af0d-303cf8257f2f tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:46.372731 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2e18ae47-b0f8-42ff-af0d-303cf8257f2f tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:46.721739 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-2e18ae47-b0f8-42ff-af0d-303cf8257f2f tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:46.731173 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-2e18ae47-b0f8-42ff-af0d-303cf8257f2f tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1359 microversion: 2.1 time: 0.385885 Jul 05 16:12:46.732162 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 272/550] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:46 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1359 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:46.843961 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-164bbec1-1e46-4c9f-ab90-b79b39028b6d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:46.844536 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-164bbec1-1e46-4c9f-ab90-b79b39028b6d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:46.855701 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-164bbec1-1e46-4c9f-ab90-b79b39028b6d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:46.869916 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-164bbec1-1e46-4c9f-ab90-b79b39028b6d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:46.890926 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-164bbec1-1e46-4c9f-ab90-b79b39028b6d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:46.890926 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-164bbec1-1e46-4c9f-ab90-b79b39028b6d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:47.099134 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-164bbec1-1e46-4c9f-ab90-b79b39028b6d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:47.099134 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-164bbec1-1e46-4c9f-ab90-b79b39028b6d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1734 microversion: 2.1 time: 0.249022 Jul 05 16:12:47.099134 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 279/551] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:46 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1734 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:47.258928 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-c23d4a89-6d28-41a2-b946-7291839c7f76 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:47.259584 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-c23d4a89-6d28-41a2-b946-7291839c7f76 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:47.278210 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c23d4a89-6d28-41a2-b946-7291839c7f76 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:47.278818 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c23d4a89-6d28-41a2-b946-7291839c7f76 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:47.279869 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c23d4a89-6d28-41a2-b946-7291839c7f76 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:47.280383 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c23d4a89-6d28-41a2-b946-7291839c7f76 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:47.541976 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c23d4a89-6d28-41a2-b946-7291839c7f76 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:47.575316 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-c23d4a89-6d28-41a2-b946-7291839c7f76 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1675 microversion: 2.1 time: 0.321111 Jul 05 16:12:47.581041 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 273/552] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:47 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1675 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:47.750908 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-a5425277-ee18-4e1d-8298-2fcc7ff18078 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:47.752141 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-a5425277-ee18-4e1d-8298-2fcc7ff18078 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:47.767133 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a5425277-ee18-4e1d-8298-2fcc7ff18078 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:47.773872 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a5425277-ee18-4e1d-8298-2fcc7ff18078 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:47.775280 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a5425277-ee18-4e1d-8298-2fcc7ff18078 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:47.776066 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a5425277-ee18-4e1d-8298-2fcc7ff18078 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:48.016469 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-a5425277-ee18-4e1d-8298-2fcc7ff18078 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:48.027160 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-a5425277-ee18-4e1d-8298-2fcc7ff18078 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1359 microversion: 2.1 time: 0.282354 Jul 05 16:12:48.027738 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 280/553] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:47 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1359 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:48.107318 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-f6bcc6f1-f6fd-479b-abfb-38964f43044d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:48.107976 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-f6bcc6f1-f6fd-479b-abfb-38964f43044d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:48.123190 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f6bcc6f1-f6fd-479b-abfb-38964f43044d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:48.123743 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f6bcc6f1-f6fd-479b-abfb-38964f43044d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:48.124691 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f6bcc6f1-f6fd-479b-abfb-38964f43044d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:48.125441 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f6bcc6f1-f6fd-479b-abfb-38964f43044d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:48.360620 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-f6bcc6f1-f6fd-479b-abfb-38964f43044d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:48.368610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-f6bcc6f1-f6fd-479b-abfb-38964f43044d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1734 microversion: 2.1 time: 0.265206 Jul 05 16:12:48.369220 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 274/554] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:48 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1734 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:48.594188 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-e02e7c18-b94a-4acb-81db-cca9631ada8c tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:48.595517 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-e02e7c18-b94a-4acb-81db-cca9631ada8c tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:48.608721 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e02e7c18-b94a-4acb-81db-cca9631ada8c tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:48.610741 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e02e7c18-b94a-4acb-81db-cca9631ada8c tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:48.613703 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e02e7c18-b94a-4acb-81db-cca9631ada8c tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:48.614384 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e02e7c18-b94a-4acb-81db-cca9631ada8c tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:48.875826 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-e02e7c18-b94a-4acb-81db-cca9631ada8c tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:48.879439 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell1:SELECT=100 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:48.886989 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-e02e7c18-b94a-4acb-81db-cca9631ada8c tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1675 microversion: 2.1 time: 0.297217 Jul 05 16:12:48.889081 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 281/555] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:48 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1675 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:49.044504 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-90c2cbc4-fa1d-4516-af0d-effa49a1a205 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:49.045409 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-90c2cbc4-fa1d-4516-af0d-effa49a1a205 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:49.065982 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-90c2cbc4-fa1d-4516-af0d-effa49a1a205 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:49.067088 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-90c2cbc4-fa1d-4516-af0d-effa49a1a205 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:49.068248 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-90c2cbc4-fa1d-4516-af0d-effa49a1a205 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:49.069212 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-90c2cbc4-fa1d-4516-af0d-effa49a1a205 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:49.353889 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-90c2cbc4-fa1d-4516-af0d-effa49a1a205 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:49.374964 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-90c2cbc4-fa1d-4516-af0d-effa49a1a205 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1359 microversion: 2.1 time: 0.332075 Jul 05 16:12:49.378634 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 275/556] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:49 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1359 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:49.393894 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-10a7a21b-89bd-491f-a3e8-16b3d2c2b212 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:49.395335 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-10a7a21b-89bd-491f-a3e8-16b3d2c2b212 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:49.405078 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-10a7a21b-89bd-491f-a3e8-16b3d2c2b212 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:49.406666 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-10a7a21b-89bd-491f-a3e8-16b3d2c2b212 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:49.408534 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-10a7a21b-89bd-491f-a3e8-16b3d2c2b212 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:49.409304 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-10a7a21b-89bd-491f-a3e8-16b3d2c2b212 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:49.720099 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-10a7a21b-89bd-491f-a3e8-16b3d2c2b212 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:49.729004 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-10a7a21b-89bd-491f-a3e8-16b3d2c2b212 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1734 microversion: 2.1 time: 0.340212 Jul 05 16:12:49.741118 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 282/557] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:49 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1734 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:49.906212 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-50884a36-22be-4110-b3ab-9634ba665fc7 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:49.907036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-50884a36-22be-4110-b3ab-9634ba665fc7 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:49.916007 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-50884a36-22be-4110-b3ab-9634ba665fc7 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:49.918775 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-50884a36-22be-4110-b3ab-9634ba665fc7 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:49.920396 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-50884a36-22be-4110-b3ab-9634ba665fc7 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:49.922269 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-50884a36-22be-4110-b3ab-9634ba665fc7 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:50.179342 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-72388a91-1c99-4f8f-b687-b167300e53f7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-174655766", "imageRef": "c5805086-2ebd-4742-8185-f79894fef91e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "77ec7356-4bd9-42af-abe3-f1b9c525bdef"}], "security_groups": [{"name": "tempest-securitygroup--2056274426"}], "key_name": "tempest-keypair-2084398981", "user_data": "}} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:12:50.200197 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-50884a36-22be-4110-b3ab-9634ba665fc7 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:50.216158 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-50884a36-22be-4110-b3ab-9634ba665fc7 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1675 microversion: 2.1 time: 0.308689 Jul 05 16:12:50.221707 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 276/558] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:49 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1675 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:50.405873 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-141b6d54-7688-4299-8400-6a2f20c2e431 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:50.407367 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-141b6d54-7688-4299-8400-6a2f20c2e431 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:50.420079 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-141b6d54-7688-4299-8400-6a2f20c2e431 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:50.420999 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-141b6d54-7688-4299-8400-6a2f20c2e431 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:50.422169 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-141b6d54-7688-4299-8400-6a2f20c2e431 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:50.422914 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-141b6d54-7688-4299-8400-6a2f20c2e431 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:50.658424 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-141b6d54-7688-4299-8400-6a2f20c2e431 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:50.680847 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-141b6d54-7688-4299-8400-6a2f20c2e431 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1359 microversion: 2.1 time: 0.290044 Jul 05 16:12:50.682855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 277/559] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:50 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1359 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:12:50.750398 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-42d4eea2-545e-45d4-9ae4-8c90d8d0da8d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:50.751633 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-42d4eea2-545e-45d4-9ae4-8c90d8d0da8d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:50.774329 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-42d4eea2-545e-45d4-9ae4-8c90d8d0da8d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:50.775096 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-42d4eea2-545e-45d4-9ae4-8c90d8d0da8d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:50.776342 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-42d4eea2-545e-45d4-9ae4-8c90d8d0da8d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:50.781695 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-42d4eea2-545e-45d4-9ae4-8c90d8d0da8d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:51.221068 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-42d4eea2-545e-45d4-9ae4-8c90d8d0da8d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:51.240617 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-42d4eea2-545e-45d4-9ae4-8c90d8d0da8d tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1734 microversion: 2.1 time: 0.496544 Jul 05 16:12:51.241515 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 278/560] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:50 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1734 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:12:51.257407 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-e8f04062-b85f-4c37-8d78-774c2c41984b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:51.258038 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-e8f04062-b85f-4c37-8d78-774c2c41984b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:51.267334 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e8f04062-b85f-4c37-8d78-774c2c41984b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:51.267733 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e8f04062-b85f-4c37-8d78-774c2c41984b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:51.268580 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e8f04062-b85f-4c37-8d78-774c2c41984b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:51.273210 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e8f04062-b85f-4c37-8d78-774c2c41984b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:51.425268 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-e8f04062-b85f-4c37-8d78-774c2c41984b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:51.441031 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-e8f04062-b85f-4c37-8d78-774c2c41984b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1652 microversion: 2.1 time: 0.198492 Jul 05 16:12:51.441940 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 279/561] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:51 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1652 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:51.468280 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-69715553-cb50-4b44-82c5-a6a748649b9f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:12:51.475248 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-69715553-cb50-4b44-82c5-a6a748649b9f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:51.478715 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-69715553-cb50-4b44-82c5-a6a748649b9f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:51.510028 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-69715553-cb50-4b44-82c5-a6a748649b9f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Going to try to start instance {{(pid=118320) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 05 16:12:51.531617 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=100 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:51.574398 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.network.neutron [None req-72388a91-1c99-4f8f-b687-b167300e53f7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] validate_networks() for [('77ec7356-4bd9-42af-abe3-f1b9c525bdef', None, None, None, None, None)] {{(pid=118319) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 16:12:51.711523 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-69715553-cb50-4b44-82c5-a6a748649b9f tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "POST /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74/action" status: 202 len: 0 microversion: 2.1 time: 0.247172 Jul 05 16:12:51.713956 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 280/562] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Jul 5 16:12:51 2022] POST /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 05 16:12:51.719275 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-d7d0c3fa-bf82-4ced-b43f-9058ffa50266 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:51.719984 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-d7d0c3fa-bf82-4ced-b43f-9058ffa50266 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:51.729859 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d7d0c3fa-bf82-4ced-b43f-9058ffa50266 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:51.730301 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d7d0c3fa-bf82-4ced-b43f-9058ffa50266 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:51.731094 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d7d0c3fa-bf82-4ced-b43f-9058ffa50266 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:51.731531 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d7d0c3fa-bf82-4ced-b43f-9058ffa50266 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:51.969952 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-d7d0c3fa-bf82-4ced-b43f-9058ffa50266 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:51.980810 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-d7d0c3fa-bf82-4ced-b43f-9058ffa50266 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1359 microversion: 2.1 time: 0.265722 Jul 05 16:12:51.982666 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 281/563] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:51 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1359 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:51.988199 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-a12e0e27-dfd3-452b-ad2d-c1cfa49601db tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:51.989074 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-a12e0e27-dfd3-452b-ad2d-c1cfa49601db tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:51.997212 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a12e0e27-dfd3-452b-ad2d-c1cfa49601db tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:51.997789 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a12e0e27-dfd3-452b-ad2d-c1cfa49601db tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:51.998732 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a12e0e27-dfd3-452b-ad2d-c1cfa49601db tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:51.999250 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a12e0e27-dfd3-452b-ad2d-c1cfa49601db tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:52.189773 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-72388a91-1c99-4f8f-b687-b167300e53f7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Flavor limits 0:0:0 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 16:12:52.190842 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-72388a91-1c99-4f8f-b687-b167300e53f7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Image limits 0:0:0 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 16:12:52.191425 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-72388a91-1c99-4f8f-b687-b167300e53f7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Flavor pref 0:0:0 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 16:12:52.191877 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-72388a91-1c99-4f8f-b687-b167300e53f7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Image pref 0:0:0 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 16:12:52.192388 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.virt.hardware [None req-72388a91-1c99-4f8f-b687-b167300e53f7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 16:12:52.208596 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-72388a91-1c99-4f8f-b687-b167300e53f7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:52.210243 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-72388a91-1c99-4f8f-b687-b167300e53f7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:52.211810 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-72388a91-1c99-4f8f-b687-b167300e53f7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:52.212580 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-72388a91-1c99-4f8f-b687-b167300e53f7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:52.222005 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-a12e0e27-dfd3-452b-ad2d-c1cfa49601db tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:52.231748 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-a12e0e27-dfd3-452b-ad2d-c1cfa49601db tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1661 microversion: 2.1 time: 0.247837 Jul 05 16:12:52.232801 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 282/564] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:51 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1661 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:52.251163 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.quota [None req-72388a91-1c99-4f8f-b687-b167300e53f7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Getting quotas for project 42e6ad67dbf542528726c545872ac10c. Resources: {'ram', 'instances', 'cores'} {{(pid=118319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:12:52.257214 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.quota [None req-72388a91-1c99-4f8f-b687-b167300e53f7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Getting quotas for user 0c8512e7c1704fac9cc4fcfe3bf1f18b and project 42e6ad67dbf542528726c545872ac10c. Resources: {'ram', 'instances', 'cores'} {{(pid=118319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:12:52.257743 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-29a46d9b-95a6-4e3e-b26c-77177bf4cf62 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:52.258364 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-29a46d9b-95a6-4e3e-b26c-77177bf4cf62 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:52.264406 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-29a46d9b-95a6-4e3e-b26c-77177bf4cf62 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:52.264896 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-29a46d9b-95a6-4e3e-b26c-77177bf4cf62 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:52.265881 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-29a46d9b-95a6-4e3e-b26c-77177bf4cf62 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:52.266112 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-29a46d9b-95a6-4e3e-b26c-77177bf4cf62 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:52.275470 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-72388a91-1c99-4f8f-b687-b167300e53f7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Going to run 1 instances... {{(pid=118319) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 16:12:52.278718 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-72388a91-1c99-4f8f-b687-b167300e53f7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 1f42f67a-5eab-461d-9467-84aea8666852] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5805086-2ebd-4742-8185-f79894fef91e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 16:12:52.422580 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-72388a91-1c99-4f8f-b687-b167300e53f7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.248725 Jul 05 16:12:52.428849 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 283/565] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Jul 5 16:12:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 2256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 05 16:12:52.434035 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-4a10ee0d-62f8-49d9-bcff-cdd839355156 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:52.434850 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-4a10ee0d-62f8-49d9-bcff-cdd839355156 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 1f42f67a-5eab-461d-9467-84aea8666852] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:52.447870 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-29a46d9b-95a6-4e3e-b26c-77177bf4cf62 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:52.463821 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-29a46d9b-95a6-4e3e-b26c-77177bf4cf62 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1734 microversion: 2.1 time: 0.209763 Jul 05 16:12:52.478262 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 283/566] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:52 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1734 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:52.524909 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-4a10ee0d-62f8-49d9-bcff-cdd839355156 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:52.532915 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-4a10ee0d-62f8-49d9-bcff-cdd839355156 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852" status: 200 len: 1241 microversion: 2.1 time: 0.102646 Jul 05 16:12:52.533701 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 284/567] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:52 2022] GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852 => generated 1241 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:52.999679 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-45ba24bd-7413-48d6-ada2-55daa45db352 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:53.000343 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-45ba24bd-7413-48d6-ada2-55daa45db352 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:53.006913 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-45ba24bd-7413-48d6-ada2-55daa45db352 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:53.007538 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-45ba24bd-7413-48d6-ada2-55daa45db352 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:53.008445 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-45ba24bd-7413-48d6-ada2-55daa45db352 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:53.008919 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-45ba24bd-7413-48d6-ada2-55daa45db352 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:53.211448 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-45ba24bd-7413-48d6-ada2-55daa45db352 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:53.218937 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-45ba24bd-7413-48d6-ada2-55daa45db352 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1359 microversion: 2.1 time: 0.223310 Jul 05 16:12:53.220368 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 284/568] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:52 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:53.250779 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-ab64ff1b-7f6e-4a23-ad87-75d14fce2009 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:53.251419 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-ab64ff1b-7f6e-4a23-ad87-75d14fce2009 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:53.258043 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ab64ff1b-7f6e-4a23-ad87-75d14fce2009 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:53.258495 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ab64ff1b-7f6e-4a23-ad87-75d14fce2009 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:53.259423 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ab64ff1b-7f6e-4a23-ad87-75d14fce2009 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:53.259864 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ab64ff1b-7f6e-4a23-ad87-75d14fce2009 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:53.460516 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-ab64ff1b-7f6e-4a23-ad87-75d14fce2009 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:53.469430 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-ab64ff1b-7f6e-4a23-ad87-75d14fce2009 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1661 microversion: 2.1 time: 0.222299 Jul 05 16:12:53.470027 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 285/569] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:53 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1661 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:53.481572 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-ee58ed73-334f-4b96-b7d9-720d65958479 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:53.482334 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-ee58ed73-334f-4b96-b7d9-720d65958479 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:53.488699 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ee58ed73-334f-4b96-b7d9-720d65958479 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:53.489404 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ee58ed73-334f-4b96-b7d9-720d65958479 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:53.490915 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ee58ed73-334f-4b96-b7d9-720d65958479 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:53.491508 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ee58ed73-334f-4b96-b7d9-720d65958479 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:53.550775 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-2eaf824b-4bc6-4a2f-8499-643b4237c39c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:53.551621 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-2eaf824b-4bc6-4a2f-8499-643b4237c39c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 1f42f67a-5eab-461d-9467-84aea8666852] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:53.562251 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2eaf824b-4bc6-4a2f-8499-643b4237c39c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:53.562991 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2eaf824b-4bc6-4a2f-8499-643b4237c39c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:53.564351 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2eaf824b-4bc6-4a2f-8499-643b4237c39c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:53.564811 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2eaf824b-4bc6-4a2f-8499-643b4237c39c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:53.656959 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-2eaf824b-4bc6-4a2f-8499-643b4237c39c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:53.660582 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-ee58ed73-334f-4b96-b7d9-720d65958479 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:53.666369 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-2eaf824b-4bc6-4a2f-8499-643b4237c39c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852" status: 200 len: 1245 microversion: 2.1 time: 0.119519 Jul 05 16:12:53.666942 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 286/570] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:53 2022] GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852 => generated 1245 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:12:53.669484 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-ee58ed73-334f-4b96-b7d9-720d65958479 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1734 microversion: 2.1 time: 0.192153 Jul 05 16:12:53.670050 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 285/571] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:53 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1734 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:54.235597 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-7dff0e57-2506-4f80-a8c9-74f90301e900 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:54.236218 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-7dff0e57-2506-4f80-a8c9-74f90301e900 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:54.242919 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7dff0e57-2506-4f80-a8c9-74f90301e900 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:54.243372 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7dff0e57-2506-4f80-a8c9-74f90301e900 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:54.244137 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7dff0e57-2506-4f80-a8c9-74f90301e900 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:54.244579 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7dff0e57-2506-4f80-a8c9-74f90301e900 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:54.374833 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-7dff0e57-2506-4f80-a8c9-74f90301e900 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:54.383073 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-7dff0e57-2506-4f80-a8c9-74f90301e900 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1359 microversion: 2.1 time: 0.151560 Jul 05 16:12:54.383640 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 287/572] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:54 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:54.486681 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-ffbf9f25-d13a-4094-8f1a-254c769fa1c4 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:54.487301 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-ffbf9f25-d13a-4094-8f1a-254c769fa1c4 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:54.494692 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ffbf9f25-d13a-4094-8f1a-254c769fa1c4 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:54.495148 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ffbf9f25-d13a-4094-8f1a-254c769fa1c4 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:54.495985 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ffbf9f25-d13a-4094-8f1a-254c769fa1c4 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:54.496426 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ffbf9f25-d13a-4094-8f1a-254c769fa1c4 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:54.634943 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-ffbf9f25-d13a-4094-8f1a-254c769fa1c4 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:54.642557 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-ffbf9f25-d13a-4094-8f1a-254c769fa1c4 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1661 microversion: 2.1 time: 0.160069 Jul 05 16:12:54.643123 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 286/573] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:54 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1661 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:54.683164 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-903dbf51-2080-436c-9830-76bd0555c873 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:54.683842 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-903dbf51-2080-436c-9830-76bd0555c873 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 1f42f67a-5eab-461d-9467-84aea8666852] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:54.687218 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-13523ec4-b2c6-440e-a0d7-7e33e0ce3141 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:54.688002 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-13523ec4-b2c6-440e-a0d7-7e33e0ce3141 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:54.691808 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-903dbf51-2080-436c-9830-76bd0555c873 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:54.692271 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-903dbf51-2080-436c-9830-76bd0555c873 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:54.693660 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-903dbf51-2080-436c-9830-76bd0555c873 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:54.694097 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-903dbf51-2080-436c-9830-76bd0555c873 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:54.694764 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-13523ec4-b2c6-440e-a0d7-7e33e0ce3141 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:54.695249 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-13523ec4-b2c6-440e-a0d7-7e33e0ce3141 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:54.696005 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-13523ec4-b2c6-440e-a0d7-7e33e0ce3141 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:54.696438 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-13523ec4-b2c6-440e-a0d7-7e33e0ce3141 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:54.763776 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-903dbf51-2080-436c-9830-76bd0555c873 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:54.771459 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-903dbf51-2080-436c-9830-76bd0555c873 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852" status: 200 len: 1293 microversion: 2.1 time: 0.092328 Jul 05 16:12:54.775776 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 288/574] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:54 2022] GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852 => generated 1293 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:54.917431 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-13523ec4-b2c6-440e-a0d7-7e33e0ce3141 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:54.925717 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-13523ec4-b2c6-440e-a0d7-7e33e0ce3141 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1734 microversion: 2.1 time: 0.242356 Jul 05 16:12:54.926289 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 287/575] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:54 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1734 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:12:55.400238 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-284a40d9-67c7-4e3a-88e1-24be4cecdff3 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:55.400802 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-284a40d9-67c7-4e3a-88e1-24be4cecdff3 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:55.406870 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-284a40d9-67c7-4e3a-88e1-24be4cecdff3 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:55.407312 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-284a40d9-67c7-4e3a-88e1-24be4cecdff3 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:55.408063 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-284a40d9-67c7-4e3a-88e1-24be4cecdff3 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:55.408493 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-284a40d9-67c7-4e3a-88e1-24be4cecdff3 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:55.539908 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-284a40d9-67c7-4e3a-88e1-24be4cecdff3 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:55.549736 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-284a40d9-67c7-4e3a-88e1-24be4cecdff3 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1359 microversion: 2.1 time: 0.153938 Jul 05 16:12:55.552834 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 289/576] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:55 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:55.666026 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-5ba8eca0-f400-48c4-bbdb-977c9afaa76a tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:55.666653 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-5ba8eca0-f400-48c4-bbdb-977c9afaa76a tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:55.674348 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5ba8eca0-f400-48c4-bbdb-977c9afaa76a tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:55.674802 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5ba8eca0-f400-48c4-bbdb-977c9afaa76a tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:55.675619 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5ba8eca0-f400-48c4-bbdb-977c9afaa76a tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:55.676067 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5ba8eca0-f400-48c4-bbdb-977c9afaa76a tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:55.789207 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-fdf9b01a-6376-4cb9-9658-39a7678df02a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:55.789827 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-fdf9b01a-6376-4cb9-9658-39a7678df02a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 1f42f67a-5eab-461d-9467-84aea8666852] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:55.796269 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fdf9b01a-6376-4cb9-9658-39a7678df02a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:55.796712 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fdf9b01a-6376-4cb9-9658-39a7678df02a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:55.797522 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fdf9b01a-6376-4cb9-9658-39a7678df02a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:55.798182 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fdf9b01a-6376-4cb9-9658-39a7678df02a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:55.816969 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-5ba8eca0-f400-48c4-bbdb-977c9afaa76a tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:55.823767 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-5ba8eca0-f400-48c4-bbdb-977c9afaa76a tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1665 microversion: 2.1 time: 0.167220 Jul 05 16:12:55.824552 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 288/577] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:55 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1665 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:55.867533 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-fdf9b01a-6376-4cb9-9658-39a7678df02a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:55.876807 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-fdf9b01a-6376-4cb9-9658-39a7678df02a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852" status: 200 len: 1299 microversion: 2.1 time: 0.092343 Jul 05 16:12:55.881048 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 290/578] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:55 2022] GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852 => generated 1299 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:55.943795 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-a0f8e105-2a3f-4ed5-8994-75d8e5d289b3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:55.944407 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-a0f8e105-2a3f-4ed5-8994-75d8e5d289b3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:55.950800 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a0f8e105-2a3f-4ed5-8994-75d8e5d289b3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:55.951378 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a0f8e105-2a3f-4ed5-8994-75d8e5d289b3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:55.952218 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a0f8e105-2a3f-4ed5-8994-75d8e5d289b3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:55.952749 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a0f8e105-2a3f-4ed5-8994-75d8e5d289b3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:56.055757 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell0:SELECT=4 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:12:56.090147 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-a0f8e105-2a3f-4ed5-8994-75d8e5d289b3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:56.098660 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-a0f8e105-2a3f-4ed5-8994-75d8e5d289b3 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1734 microversion: 2.1 time: 0.159260 Jul 05 16:12:56.104887 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 289/579] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:55 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:56.567098 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-93411397-943c-44b5-bb36-68b6d615d9c4 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:56.568085 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-93411397-943c-44b5-bb36-68b6d615d9c4 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:56.574274 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-93411397-943c-44b5-bb36-68b6d615d9c4 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:56.574718 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-93411397-943c-44b5-bb36-68b6d615d9c4 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:56.575481 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-93411397-943c-44b5-bb36-68b6d615d9c4 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:56.576104 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-93411397-943c-44b5-bb36-68b6d615d9c4 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:56.806528 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-93411397-943c-44b5-bb36-68b6d615d9c4 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:56.832977 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-93411397-943c-44b5-bb36-68b6d615d9c4 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1359 microversion: 2.1 time: 0.267341 Jul 05 16:12:56.843414 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 291/580] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:56 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1359 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:56.894829 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-94e8cabb-fd39-441e-a94b-c0c1472103cc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:56.895561 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-94e8cabb-fd39-441e-a94b-c0c1472103cc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 1f42f67a-5eab-461d-9467-84aea8666852] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:56.909484 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-94e8cabb-fd39-441e-a94b-c0c1472103cc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:56.909484 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-94e8cabb-fd39-441e-a94b-c0c1472103cc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:56.909484 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-94e8cabb-fd39-441e-a94b-c0c1472103cc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:56.909484 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-94e8cabb-fd39-441e-a94b-c0c1472103cc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:57.117039 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-2bbf9d7b-a0b9-490b-9a6c-03c3d4460ff6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:57.118030 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-2bbf9d7b-a0b9-490b-9a6c-03c3d4460ff6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:57.124899 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2bbf9d7b-a0b9-490b-9a6c-03c3d4460ff6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:57.125656 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2bbf9d7b-a0b9-490b-9a6c-03c3d4460ff6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:57.126777 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2bbf9d7b-a0b9-490b-9a6c-03c3d4460ff6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:57.127551 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2bbf9d7b-a0b9-490b-9a6c-03c3d4460ff6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:57.365702 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-94e8cabb-fd39-441e-a94b-c0c1472103cc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:57.374393 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-94e8cabb-fd39-441e-a94b-c0c1472103cc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852" status: 200 len: 1367 microversion: 2.1 time: 0.483483 Jul 05 16:12:57.384425 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 290/581] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:56 2022] GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852 => generated 1367 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:57.395350 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-f0ec1126-611b-408b-98ff-0700d8f8c0a6 req-164f98e4-814c-494f-91b6-4d7483b9778c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f42f67a-5eab-461d-9467-84aea8666852", "tag": "56eeb76f-52f3-4f96-bf88-99c80eacdaa7"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:12:57.397899 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-f0ec1126-611b-408b-98ff-0700d8f8c0a6 req-164f98e4-814c-494f-91b6-4d7483b9778c service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:57.398514 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-f0ec1126-611b-408b-98ff-0700d8f8c0a6 req-164f98e4-814c-494f-91b6-4d7483b9778c service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:57.410906 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-f0ec1126-611b-408b-98ff-0700d8f8c0a6 req-164f98e4-814c-494f-91b6-4d7483b9778c service nova] Creating event network-changed:56eeb76f-52f3-4f96-bf88-99c80eacdaa7 for instance 1f42f67a-5eab-461d-9467-84aea8666852 on hv-cinder-84875 Jul 05 16:12:57.417302 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-f0ec1126-611b-408b-98ff-0700d8f8c0a6 req-164f98e4-814c-494f-91b6-4d7483b9778c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031585 Jul 05 16:12:57.418125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 291/582] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:12:57.433536 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-2bbf9d7b-a0b9-490b-9a6c-03c3d4460ff6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:57.442240 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-2bbf9d7b-a0b9-490b-9a6c-03c3d4460ff6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1734 microversion: 2.1 time: 0.330262 Jul 05 16:12:57.444439 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 292/583] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:57 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1734 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:12:57.736947 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-64ad3c67-75d5-4e3d-93f9-6f062ae4c8d8 req-1e9edaaf-a4a9-4f7e-9fd0-ddf4627007bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7e85e1f-39bb-4c8c-addb-85ae261a3eb7", "name": "network-vif-plugged", "status": "completed", "tag": "0acdc586-b1e0-458b-8b41-006c61e42c40"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:12:57.746306 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-64ad3c67-75d5-4e3d-93f9-6f062ae4c8d8 req-1e9edaaf-a4a9-4f7e-9fd0-ddf4627007bd service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:57.749568 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-64ad3c67-75d5-4e3d-93f9-6f062ae4c8d8 req-1e9edaaf-a4a9-4f7e-9fd0-ddf4627007bd service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:57.757379 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-64ad3c67-75d5-4e3d-93f9-6f062ae4c8d8 req-1e9edaaf-a4a9-4f7e-9fd0-ddf4627007bd service nova] Creating event network-vif-plugged:0acdc586-b1e0-458b-8b41-006c61e42c40 for instance e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 on hv-cinder-84875 Jul 05 16:12:57.762077 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-64ad3c67-75d5-4e3d-93f9-6f062ae4c8d8 req-1e9edaaf-a4a9-4f7e-9fd0-ddf4627007bd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029842 Jul 05 16:12:57.762655 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 292/584] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:12:57.851135 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-58a50cd5-57fc-4993-9a8f-c773f2713f0f tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:57.852344 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-58a50cd5-57fc-4993-9a8f-c773f2713f0f tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:57.860191 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-58a50cd5-57fc-4993-9a8f-c773f2713f0f tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:57.860641 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-58a50cd5-57fc-4993-9a8f-c773f2713f0f tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:57.861442 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-58a50cd5-57fc-4993-9a8f-c773f2713f0f tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:57.861912 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-58a50cd5-57fc-4993-9a8f-c773f2713f0f tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:58.012751 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-58a50cd5-57fc-4993-9a8f-c773f2713f0f tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:58.020084 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-58a50cd5-57fc-4993-9a8f-c773f2713f0f tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1359 microversion: 2.1 time: 0.173773 Jul 05 16:12:58.020674 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 293/585] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:57 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:58.392283 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-2edb7e59-a690-40b6-9d31-b7a0eb779676 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:58.393037 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-2edb7e59-a690-40b6-9d31-b7a0eb779676 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 1f42f67a-5eab-461d-9467-84aea8666852] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:58.400145 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2edb7e59-a690-40b6-9d31-b7a0eb779676 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:58.400709 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2edb7e59-a690-40b6-9d31-b7a0eb779676 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:58.401512 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2edb7e59-a690-40b6-9d31-b7a0eb779676 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:58.401977 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2edb7e59-a690-40b6-9d31-b7a0eb779676 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:58.463697 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-c810816a-fd0b-4469-9155-ad90211c2efc tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:58.464433 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-c810816a-fd0b-4469-9155-ad90211c2efc tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:58.470740 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c810816a-fd0b-4469-9155-ad90211c2efc tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:58.471322 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c810816a-fd0b-4469-9155-ad90211c2efc tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:58.472269 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c810816a-fd0b-4469-9155-ad90211c2efc tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:58.472723 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c810816a-fd0b-4469-9155-ad90211c2efc tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:58.578416 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-2edb7e59-a690-40b6-9d31-b7a0eb779676 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:58.586748 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-2edb7e59-a690-40b6-9d31-b7a0eb779676 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852" status: 200 len: 1367 microversion: 2.1 time: 0.199252 Jul 05 16:12:58.587486 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 293/586] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:58 2022] GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:58.630342 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-c810816a-fd0b-4469-9155-ad90211c2efc tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:58.638409 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-c810816a-fd0b-4469-9155-ad90211c2efc tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1734 microversion: 2.1 time: 0.178844 Jul 05 16:12:58.638972 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 294/587] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:58 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:59.036742 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-bfb4ebb9-2e38-4aa4-a07a-2dafb0c45c8d tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:59.037580 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-bfb4ebb9-2e38-4aa4-a07a-2dafb0c45c8d tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:59.043701 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bfb4ebb9-2e38-4aa4-a07a-2dafb0c45c8d tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:59.044403 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bfb4ebb9-2e38-4aa4-a07a-2dafb0c45c8d tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:59.045381 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bfb4ebb9-2e38-4aa4-a07a-2dafb0c45c8d tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:59.045822 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bfb4ebb9-2e38-4aa4-a07a-2dafb0c45c8d tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:59.181905 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-bfb4ebb9-2e38-4aa4-a07a-2dafb0c45c8d tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:59.188100 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-bfb4ebb9-2e38-4aa4-a07a-2dafb0c45c8d tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1359 microversion: 2.1 time: 0.155107 Jul 05 16:12:59.188666 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 294/588] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:59 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:59.603587 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-25428339-c9e1-448d-9e03-9d79362a604c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:59.604387 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-25428339-c9e1-448d-9e03-9d79362a604c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 1f42f67a-5eab-461d-9467-84aea8666852] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:59.611092 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-25428339-c9e1-448d-9e03-9d79362a604c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:59.611539 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-25428339-c9e1-448d-9e03-9d79362a604c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:59.612302 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-25428339-c9e1-448d-9e03-9d79362a604c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:59.612736 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-25428339-c9e1-448d-9e03-9d79362a604c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:59.655931 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-ce7f0128-7520-4087-b0ac-314966470629 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:12:59.657278 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-ce7f0128-7520-4087-b0ac-314966470629 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:12:59.664445 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ce7f0128-7520-4087-b0ac-314966470629 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:59.665055 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ce7f0128-7520-4087-b0ac-314966470629 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:59.665837 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ce7f0128-7520-4087-b0ac-314966470629 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:12:59.666339 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ce7f0128-7520-4087-b0ac-314966470629 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:12:59.807338 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-25428339-c9e1-448d-9e03-9d79362a604c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:59.815738 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-25428339-c9e1-448d-9e03-9d79362a604c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852" status: 200 len: 1367 microversion: 2.1 time: 0.215922 Jul 05 16:12:59.816317 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 295/589] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:59 2022] GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:12:59.840523 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-ce7f0128-7520-4087-b0ac-314966470629 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:12:59.848513 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-ce7f0128-7520-4087-b0ac-314966470629 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1734 microversion: 2.1 time: 0.196896 Jul 05 16:12:59.849128 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 295/590] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:12:59 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1734 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:13:00.205588 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-1aa73919-603d-409f-907e-df7d659978c5 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:00.206216 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-1aa73919-603d-409f-907e-df7d659978c5 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:00.212898 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1aa73919-603d-409f-907e-df7d659978c5 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:00.213343 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1aa73919-603d-409f-907e-df7d659978c5 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:00.214173 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1aa73919-603d-409f-907e-df7d659978c5 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:00.214613 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1aa73919-603d-409f-907e-df7d659978c5 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:00.352890 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-1aa73919-603d-409f-907e-df7d659978c5 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:00.360868 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-1aa73919-603d-409f-907e-df7d659978c5 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1359 microversion: 2.1 time: 0.159203 Jul 05 16:13:00.361458 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 296/591] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:00 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:00.833256 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-38ccde23-33d8-4fd7-be63-7e9d0bbd25fc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:00.833967 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-38ccde23-33d8-4fd7-be63-7e9d0bbd25fc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 1f42f67a-5eab-461d-9467-84aea8666852] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:00.841292 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-38ccde23-33d8-4fd7-be63-7e9d0bbd25fc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:00.841738 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-38ccde23-33d8-4fd7-be63-7e9d0bbd25fc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:00.842502 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-38ccde23-33d8-4fd7-be63-7e9d0bbd25fc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:00.842925 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-38ccde23-33d8-4fd7-be63-7e9d0bbd25fc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:00.865814 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-f7508aee-54fc-4d6d-ae5b-8adbe35e715f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:00.866431 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-f7508aee-54fc-4d6d-ae5b-8adbe35e715f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:00.872935 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f7508aee-54fc-4d6d-ae5b-8adbe35e715f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:00.873386 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f7508aee-54fc-4d6d-ae5b-8adbe35e715f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:00.874148 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f7508aee-54fc-4d6d-ae5b-8adbe35e715f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:00.874584 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f7508aee-54fc-4d6d-ae5b-8adbe35e715f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:01.022928 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-38ccde23-33d8-4fd7-be63-7e9d0bbd25fc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:01.030346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-38ccde23-33d8-4fd7-be63-7e9d0bbd25fc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852" status: 200 len: 1367 microversion: 2.1 time: 0.201314 Jul 05 16:13:01.030914 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 296/592] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:00 2022] GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852 => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:01.048931 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-f7508aee-54fc-4d6d-ae5b-8adbe35e715f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:01.057423 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-f7508aee-54fc-4d6d-ae5b-8adbe35e715f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1734 microversion: 2.1 time: 0.195933 Jul 05 16:13:01.057986 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 297/593] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:00 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1734 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:13:01.378224 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-bb8d8308-6dbe-4da9-818f-8c62717436b9 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:01.378838 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-bb8d8308-6dbe-4da9-818f-8c62717436b9 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:01.384783 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bb8d8308-6dbe-4da9-818f-8c62717436b9 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:01.385231 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bb8d8308-6dbe-4da9-818f-8c62717436b9 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:01.386353 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bb8d8308-6dbe-4da9-818f-8c62717436b9 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:01.386687 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bb8d8308-6dbe-4da9-818f-8c62717436b9 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:01.513188 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-bb8d8308-6dbe-4da9-818f-8c62717436b9 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:01.521239 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-bb8d8308-6dbe-4da9-818f-8c62717436b9 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1550 microversion: 2.1 time: 0.146312 Jul 05 16:13:01.521810 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 297/594] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:01 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1550 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:01.537643 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-db42071c-49c6-4f50-b424-bbb0869341ba tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:01.545226 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-db42071c-49c6-4f50-b424-bbb0869341ba tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:01.545226 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-db42071c-49c6-4f50-b424-bbb0869341ba tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:01.545226 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-db42071c-49c6-4f50-b424-bbb0869341ba tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:01.545521 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-db42071c-49c6-4f50-b424-bbb0869341ba tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:01.545732 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-db42071c-49c6-4f50-b424-bbb0869341ba tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:01.680361 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-db42071c-49c6-4f50-b424-bbb0869341ba tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:01.687858 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-db42071c-49c6-4f50-b424-bbb0869341ba tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1550 microversion: 2.1 time: 0.154642 Jul 05 16:13:01.688429 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 298/595] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:01 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:01.703769 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-ae9ee5e0-b360-4fc8-b149-a56dd9854769 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:01.707446 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-ae9ee5e0-b360-4fc8-b149-a56dd9854769 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:01.708717 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-ae9ee5e0-b360-4fc8-b149-a56dd9854769 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Searching by: {'deleted': False, 'project_id': '71b68c04578747d08842aab556e98030'} {{(pid=118320) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 05 16:13:01.715371 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ae9ee5e0-b360-4fc8-b149-a56dd9854769 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:01.715864 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ae9ee5e0-b360-4fc8-b149-a56dd9854769 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:01.716652 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ae9ee5e0-b360-4fc8-b149-a56dd9854769 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:01.717115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ae9ee5e0-b360-4fc8-b149-a56dd9854769 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:01.786777 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:01.806916 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.multi_cell_list [None req-ae9ee5e0-b360-4fc8-b149-a56dd9854769 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 05 16:13:01.905750 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-ae9ee5e0-b360-4fc8-b149-a56dd9854769 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.206069 Jul 05 16:13:01.906381 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 298/596] 10.222.0.45 () {58 vars in 1124 bytes} [Tue Jul 5 16:13:01 2022] GET /compute/v2.1/servers => generated 343 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:13:01.916329 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-7aee0db1-1040-4cad-8497-6956443cff9a tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:01.916980 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-7aee0db1-1040-4cad-8497-6956443cff9a tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:01.923369 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7aee0db1-1040-4cad-8497-6956443cff9a tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:01.923813 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7aee0db1-1040-4cad-8497-6956443cff9a tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:01.924575 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7aee0db1-1040-4cad-8497-6956443cff9a tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:01.925042 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7aee0db1-1040-4cad-8497-6956443cff9a tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:02.047989 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-7d3ea974-70bf-475e-b814-edb0090b888c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:02.048605 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-7d3ea974-70bf-475e-b814-edb0090b888c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 1f42f67a-5eab-461d-9467-84aea8666852] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:02.055116 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7d3ea974-70bf-475e-b814-edb0090b888c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:02.055571 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7d3ea974-70bf-475e-b814-edb0090b888c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:02.056557 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7d3ea974-70bf-475e-b814-edb0090b888c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:02.057034 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7d3ea974-70bf-475e-b814-edb0090b888c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:02.062727 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-7aee0db1-1040-4cad-8497-6956443cff9a tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:02.070432 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-7aee0db1-1040-4cad-8497-6956443cff9a tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1550 microversion: 2.1 time: 0.157768 Jul 05 16:13:02.071396 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 299/597] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:01 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1550 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:02.077891 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-7d8857dc-1276-40f0-bd13-9c58586d4dd6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:02.078622 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-7d8857dc-1276-40f0-bd13-9c58586d4dd6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:02.085805 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7d8857dc-1276-40f0-bd13-9c58586d4dd6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:02.086355 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7d8857dc-1276-40f0-bd13-9c58586d4dd6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:02.087250 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7d8857dc-1276-40f0-bd13-9c58586d4dd6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:02.087919 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7d8857dc-1276-40f0-bd13-9c58586d4dd6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:02.094520 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell1:SELECT=100 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:02.224253 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell0:SELECT=2 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:02.276896 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-7d3ea974-70bf-475e-b814-edb0090b888c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:02.283813 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-7d8857dc-1276-40f0-bd13-9c58586d4dd6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:02.284193 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-7d3ea974-70bf-475e-b814-edb0090b888c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852" status: 200 len: 1367 microversion: 2.1 time: 0.240484 Jul 05 16:13:02.284752 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 299/598] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:02 2022] GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852 => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:13:02.295490 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-7d8857dc-1276-40f0-bd13-9c58586d4dd6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1734 microversion: 2.1 time: 0.222850 Jul 05 16:13:02.296063 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 300/599] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:02 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1734 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:03.300679 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-ed234a0c-30af-44a2-9511-9ae1f071cfe3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:03.301344 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-ed234a0c-30af-44a2-9511-9ae1f071cfe3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 1f42f67a-5eab-461d-9467-84aea8666852] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:03.307702 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ed234a0c-30af-44a2-9511-9ae1f071cfe3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:03.308148 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ed234a0c-30af-44a2-9511-9ae1f071cfe3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:03.308924 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ed234a0c-30af-44a2-9511-9ae1f071cfe3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:03.309358 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ed234a0c-30af-44a2-9511-9ae1f071cfe3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:03.317981 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-9ab54f5a-357e-4dcb-9401-d386548e5c79 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:03.318819 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-9ab54f5a-357e-4dcb-9401-d386548e5c79 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:03.320683 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell0:SELECT=8 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:03.326049 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9ab54f5a-357e-4dcb-9401-d386548e5c79 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:03.326504 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9ab54f5a-357e-4dcb-9401-d386548e5c79 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:03.327274 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9ab54f5a-357e-4dcb-9401-d386548e5c79 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:03.327712 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9ab54f5a-357e-4dcb-9401-d386548e5c79 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:03.510900 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-ed234a0c-30af-44a2-9511-9ae1f071cfe3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:03.514935 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-9ab54f5a-357e-4dcb-9401-d386548e5c79 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:03.518336 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-ed234a0c-30af-44a2-9511-9ae1f071cfe3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852" status: 200 len: 1367 microversion: 2.1 time: 0.221545 Jul 05 16:13:03.518907 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 300/600] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:03 2022] GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:03.523545 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-9ab54f5a-357e-4dcb-9401-d386548e5c79 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1734 microversion: 2.1 time: 0.210168 Jul 05 16:13:03.524119 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 301/601] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:03 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1734 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:13:03.779900 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-d52a37a1-80f0-49f5-b132-145379b048fa req-3fc0bfeb-008f-4210-9950-7db8f326273e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f42f67a-5eab-461d-9467-84aea8666852", "name": "network-vif-plugged", "status": "completed", "tag": "56eeb76f-52f3-4f96-bf88-99c80eacdaa7"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:13:03.788354 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-d52a37a1-80f0-49f5-b132-145379b048fa req-3fc0bfeb-008f-4210-9950-7db8f326273e service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:03.788713 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-d52a37a1-80f0-49f5-b132-145379b048fa req-3fc0bfeb-008f-4210-9950-7db8f326273e service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:03.799810 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-d52a37a1-80f0-49f5-b132-145379b048fa req-3fc0bfeb-008f-4210-9950-7db8f326273e service nova] Creating event network-vif-plugged:56eeb76f-52f3-4f96-bf88-99c80eacdaa7 for instance 1f42f67a-5eab-461d-9467-84aea8666852 on hv-cinder-84875 Jul 05 16:13:03.805558 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-d52a37a1-80f0-49f5-b132-145379b048fa req-3fc0bfeb-008f-4210-9950-7db8f326273e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044483 Jul 05 16:13:03.806233 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 301/602] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:13:03.914492 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-319b2b19-d744-4b4c-9972-9b4d247e1f1c tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d66407f-7df2-4581-b340-6d204a4d21d6"}} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:13:03.915622 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-319b2b19-d744-4b4c-9972-9b4d247e1f1c tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:03.921826 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-319b2b19-d744-4b4c-9972-9b4d247e1f1c tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:03.922272 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-319b2b19-d744-4b4c-9972-9b4d247e1f1c tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:03.923021 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-319b2b19-d744-4b4c-9972-9b4d247e1f1c tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:03.923454 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-319b2b19-d744-4b4c-9972-9b4d247e1f1c tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:04.537063 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-7f2742d9-b2b4-4ad0-b169-6495a5f67e59 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:04.537808 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-7f2742d9-b2b4-4ad0-b169-6495a5f67e59 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 1f42f67a-5eab-461d-9467-84aea8666852] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:04.544016 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7f2742d9-b2b4-4ad0-b169-6495a5f67e59 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:04.544476 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7f2742d9-b2b4-4ad0-b169-6495a5f67e59 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:04.545287 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7f2742d9-b2b4-4ad0-b169-6495a5f67e59 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:04.545730 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7f2742d9-b2b4-4ad0-b169-6495a5f67e59 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:04.631519 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-319b2b19-d744-4b4c-9972-9b4d247e1f1c tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "POST /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.720781 Jul 05 16:13:04.632134 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 302/603] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Jul 5 16:13:03 2022] POST /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7/os-volume_attachments => generated 194 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:13:04.642306 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-b98924c6-b4b5-41e1-87f7-2c2a27cb460a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:04.642974 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-b98924c6-b4b5-41e1-87f7-2c2a27cb460a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:04.650516 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b98924c6-b4b5-41e1-87f7-2c2a27cb460a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:04.650969 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b98924c6-b4b5-41e1-87f7-2c2a27cb460a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:04.651739 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b98924c6-b4b5-41e1-87f7-2c2a27cb460a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:04.652175 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b98924c6-b4b5-41e1-87f7-2c2a27cb460a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:04.678593 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-7f2742d9-b2b4-4ad0-b169-6495a5f67e59 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:04.688625 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-7f2742d9-b2b4-4ad0-b169-6495a5f67e59 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852" status: 200 len: 1367 microversion: 2.1 time: 0.156924 Jul 05 16:13:04.689650 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 302/604] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:04 2022] GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:13:04.783358 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-b98924c6-b4b5-41e1-87f7-2c2a27cb460a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:04.791172 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-b98924c6-b4b5-41e1-87f7-2c2a27cb460a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1734 microversion: 2.1 time: 0.153146 Jul 05 16:13:04.791737 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 303/605] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:04 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:05.705961 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-5809ca98-472c-4d3d-a5cc-d4dbcdf7072e tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:05.706719 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-5809ca98-472c-4d3d-a5cc-d4dbcdf7072e tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 1f42f67a-5eab-461d-9467-84aea8666852] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:05.713696 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5809ca98-472c-4d3d-a5cc-d4dbcdf7072e tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:05.714422 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5809ca98-472c-4d3d-a5cc-d4dbcdf7072e tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:05.715397 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5809ca98-472c-4d3d-a5cc-d4dbcdf7072e tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:05.715836 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5809ca98-472c-4d3d-a5cc-d4dbcdf7072e tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:05.808373 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-b49ca03b-ba2f-4fda-978f-aefb1491c7f2 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:05.809158 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-b49ca03b-ba2f-4fda-978f-aefb1491c7f2 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:05.818706 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b49ca03b-ba2f-4fda-978f-aefb1491c7f2 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:05.818706 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b49ca03b-ba2f-4fda-978f-aefb1491c7f2 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:05.819392 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b49ca03b-ba2f-4fda-978f-aefb1491c7f2 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:05.819937 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b49ca03b-ba2f-4fda-978f-aefb1491c7f2 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:05.852329 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-5809ca98-472c-4d3d-a5cc-d4dbcdf7072e tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:05.860345 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-5809ca98-472c-4d3d-a5cc-d4dbcdf7072e tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852" status: 200 len: 1367 microversion: 2.1 time: 0.158551 Jul 05 16:13:05.864941 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 303/606] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:05 2022] GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:05.954084 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-b49ca03b-ba2f-4fda-978f-aefb1491c7f2 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:05.962375 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-b49ca03b-ba2f-4fda-978f-aefb1491c7f2 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1734 microversion: 2.1 time: 0.157954 Jul 05 16:13:05.962949 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 304/607] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:05 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:13:06.877437 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-33b6b979-a508-4f5a-ba33-380e5d8386fa tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:06.878044 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-33b6b979-a508-4f5a-ba33-380e5d8386fa tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 1f42f67a-5eab-461d-9467-84aea8666852] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:06.884525 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-33b6b979-a508-4f5a-ba33-380e5d8386fa tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:06.885019 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-33b6b979-a508-4f5a-ba33-380e5d8386fa tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:06.885817 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-33b6b979-a508-4f5a-ba33-380e5d8386fa tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:06.886249 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-33b6b979-a508-4f5a-ba33-380e5d8386fa tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:06.979899 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-08913a79-5c9a-4e76-99c4-8dd18a2209de tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:06.980515 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-08913a79-5c9a-4e76-99c4-8dd18a2209de tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:06.987188 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-08913a79-5c9a-4e76-99c4-8dd18a2209de tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:06.987637 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-08913a79-5c9a-4e76-99c4-8dd18a2209de tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:06.988398 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-08913a79-5c9a-4e76-99c4-8dd18a2209de tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:06.988859 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-08913a79-5c9a-4e76-99c4-8dd18a2209de tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:07.013148 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-33b6b979-a508-4f5a-ba33-380e5d8386fa tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:07.021333 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-33b6b979-a508-4f5a-ba33-380e5d8386fa tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852" status: 200 len: 1558 microversion: 2.1 time: 0.147113 Jul 05 16:13:07.021993 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 304/608] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:06 2022] GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:07.037273 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-3d246724-061d-4a02-9cfd-86baaae44a15 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:07.037899 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-3d246724-061d-4a02-9cfd-86baaae44a15 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 1f42f67a-5eab-461d-9467-84aea8666852] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:07.043944 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3d246724-061d-4a02-9cfd-86baaae44a15 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:07.044468 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3d246724-061d-4a02-9cfd-86baaae44a15 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:07.045274 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3d246724-061d-4a02-9cfd-86baaae44a15 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:07.045698 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3d246724-061d-4a02-9cfd-86baaae44a15 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:07.134290 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-3d246724-061d-4a02-9cfd-86baaae44a15 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100701 Jul 05 16:13:07.134894 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 305/609] 10.222.0.45 () {58 vars in 1274 bytes} [Tue Jul 5 16:13:07 2022] GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:13:07.155818 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-08913a79-5c9a-4e76-99c4-8dd18a2209de tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:07.164280 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-08913a79-5c9a-4e76-99c4-8dd18a2209de tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1734 microversion: 2.1 time: 0.188272 Jul 05 16:13:07.164879 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 305/610] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:06 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1734 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:13:08.181835 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-10a56787-697c-4876-8331-79515fdfcb47 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:08.182476 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-10a56787-697c-4876-8331-79515fdfcb47 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:08.184435 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:08.189076 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-10a56787-697c-4876-8331-79515fdfcb47 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:08.189554 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-10a56787-697c-4876-8331-79515fdfcb47 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:08.190325 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-10a56787-697c-4876-8331-79515fdfcb47 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:08.190754 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-10a56787-697c-4876-8331-79515fdfcb47 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:08.319753 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-10a56787-697c-4876-8331-79515fdfcb47 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:08.327899 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-10a56787-697c-4876-8331-79515fdfcb47 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1734 microversion: 2.1 time: 0.150397 Jul 05 16:13:08.328607 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 306/611] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:08 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:08.394078 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [req-e5517ae3-49de-4c96-a71d-931a5e65892d req-b3a582f4-d9ba-49dc-8aa8-0790ba3906a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f42f67a-5eab-461d-9467-84aea8666852", "tag": "56eeb76f-52f3-4f96-bf88-99c80eacdaa7"}]} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:13:08.403228 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-e5517ae3-49de-4c96-a71d-931a5e65892d req-b3a582f4-d9ba-49dc-8aa8-0790ba3906a1 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:08.403676 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-e5517ae3-49de-4c96-a71d-931a5e65892d req-b3a582f4-d9ba-49dc-8aa8-0790ba3906a1 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:08.414970 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.compute.server_external_events [req-e5517ae3-49de-4c96-a71d-931a5e65892d req-b3a582f4-d9ba-49dc-8aa8-0790ba3906a1 service nova] Creating event network-changed:56eeb76f-52f3-4f96-bf88-99c80eacdaa7 for instance 1f42f67a-5eab-461d-9467-84aea8666852 on hv-cinder-84875 Jul 05 16:13:08.420068 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [req-e5517ae3-49de-4c96-a71d-931a5e65892d req-b3a582f4-d9ba-49dc-8aa8-0790ba3906a1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029674 Jul 05 16:13:08.421072 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 306/612] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:13:09.345359 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-2052d7c3-a817-4e70-a227-1c9f17ac5728 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:09.345978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-2052d7c3-a817-4e70-a227-1c9f17ac5728 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:09.353200 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2052d7c3-a817-4e70-a227-1c9f17ac5728 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:09.353654 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2052d7c3-a817-4e70-a227-1c9f17ac5728 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:09.354521 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2052d7c3-a817-4e70-a227-1c9f17ac5728 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:09.355394 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2052d7c3-a817-4e70-a227-1c9f17ac5728 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:09.490690 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-2052d7c3-a817-4e70-a227-1c9f17ac5728 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:09.498990 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-2052d7c3-a817-4e70-a227-1c9f17ac5728 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1734 microversion: 2.1 time: 0.157422 Jul 05 16:13:09.499786 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 307/613] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:09 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:09.793342 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-2cc99154-da44-4edb-94b2-f0a16115da44 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:09.793879 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-2cc99154-da44-4edb-94b2-f0a16115da44 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:09.800333 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2cc99154-da44-4edb-94b2-f0a16115da44 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:09.800797 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2cc99154-da44-4edb-94b2-f0a16115da44 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:09.801568 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2cc99154-da44-4edb-94b2-f0a16115da44 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:09.801998 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2cc99154-da44-4edb-94b2-f0a16115da44 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:09.830576 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-2cc99154-da44-4edb-94b2-f0a16115da44 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77/os-volume_attachments/db049fae-81b1-4db4-b615-e280848f36a7" status: 200 len: 194 microversion: 2.20 time: 0.041756 Jul 05 16:13:09.831135 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 307/614] 10.222.0.45 () {60 vars in 1453 bytes} [Tue Jul 5 16:13:09 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77/os-volume_attachments/db049fae-81b1-4db4-b615-e280848f36a7 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 16:13:09.892472 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-085e992d-0fad-4ade-b500-445daf94a508 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:09.892992 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-085e992d-0fad-4ade-b500-445daf94a508 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:09.899496 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-085e992d-0fad-4ade-b500-445daf94a508 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:09.899945 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-085e992d-0fad-4ade-b500-445daf94a508 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:09.900697 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-085e992d-0fad-4ade-b500-445daf94a508 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:09.901166 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-085e992d-0fad-4ade-b500-445daf94a508 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:10.030021 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.objects.instance [None req-085e992d-0fad-4ade-b500-445daf94a508 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lazy-loading 'services' on Instance uuid da368d38-2642-49c3-b499-eb5a977cbd77 {{(pid=118320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 16:13:10.278162 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-085e992d-0fad-4ade-b500-445daf94a508 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "DELETE /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77/os-volume_attachments/db049fae-81b1-4db4-b615-e280848f36a7" status: 202 len: 0 microversion: 2.20 time: 0.389404 Jul 05 16:13:10.278736 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 308/615] 10.222.0.45 () {60 vars in 1456 bytes} [Tue Jul 5 16:13:09 2022] DELETE /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77/os-volume_attachments/db049fae-81b1-4db4-b615-e280848f36a7 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 05 16:13:10.287187 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-9db5e815-48aa-4d91-aefb-a965c37d97bd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:10.288733 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-9db5e815-48aa-4d91-aefb-a965c37d97bd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:10.294418 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9db5e815-48aa-4d91-aefb-a965c37d97bd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:10.294806 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9db5e815-48aa-4d91-aefb-a965c37d97bd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:10.295583 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9db5e815-48aa-4d91-aefb-a965c37d97bd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:10.296023 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9db5e815-48aa-4d91-aefb-a965c37d97bd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:10.325024 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-9db5e815-48aa-4d91-aefb-a965c37d97bd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041956 Jul 05 16:13:10.325575 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 308/616] 10.222.0.45 () {60 vars in 1342 bytes} [Tue Jul 5 16:13:10 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 16:13:10.522066 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-e438f121-0f83-4505-8abb-8801c61e446c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:10.522798 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-e438f121-0f83-4505-8abb-8801c61e446c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:10.529039 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e438f121-0f83-4505-8abb-8801c61e446c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:10.529494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e438f121-0f83-4505-8abb-8801c61e446c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:10.530289 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e438f121-0f83-4505-8abb-8801c61e446c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:10.530731 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e438f121-0f83-4505-8abb-8801c61e446c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:10.658833 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-e438f121-0f83-4505-8abb-8801c61e446c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:10.666660 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-e438f121-0f83-4505-8abb-8801c61e446c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1734 microversion: 2.1 time: 0.149322 Jul 05 16:13:10.667230 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 309/617] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:10 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:13:11.336808 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-ccc84996-5513-49b5-9e1f-5d1d4971c7ba tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:11.337732 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-ccc84996-5513-49b5-9e1f-5d1d4971c7ba tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:11.340130 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:11.344862 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ccc84996-5513-49b5-9e1f-5d1d4971c7ba tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:11.345311 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ccc84996-5513-49b5-9e1f-5d1d4971c7ba tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:11.346070 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ccc84996-5513-49b5-9e1f-5d1d4971c7ba tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:11.346504 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ccc84996-5513-49b5-9e1f-5d1d4971c7ba tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:11.375200 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-ccc84996-5513-49b5-9e1f-5d1d4971c7ba tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042426 Jul 05 16:13:11.375753 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 309/618] 10.222.0.45 () {60 vars in 1342 bytes} [Tue Jul 5 16:13:11 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 16:13:11.683839 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-809c5032-a001-410a-8e74-82742779fa93 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:11.684475 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-809c5032-a001-410a-8e74-82742779fa93 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:11.691130 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-809c5032-a001-410a-8e74-82742779fa93 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:11.691618 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-809c5032-a001-410a-8e74-82742779fa93 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:11.692350 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-809c5032-a001-410a-8e74-82742779fa93 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:11.692812 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-809c5032-a001-410a-8e74-82742779fa93 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:11.747877 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell0:SELECT=2 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:11.834506 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-809c5032-a001-410a-8e74-82742779fa93 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:11.842706 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-809c5032-a001-410a-8e74-82742779fa93 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1734 microversion: 2.1 time: 0.162806 Jul 05 16:13:11.843277 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 310/619] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:11 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:12.386868 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-66f45741-3b51-40fc-adfd-17f52639f917 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:12.387788 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-66f45741-3b51-40fc-adfd-17f52639f917 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:12.394711 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-66f45741-3b51-40fc-adfd-17f52639f917 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:12.395845 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-66f45741-3b51-40fc-adfd-17f52639f917 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:12.396592 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-66f45741-3b51-40fc-adfd-17f52639f917 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:12.397129 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-66f45741-3b51-40fc-adfd-17f52639f917 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:12.425012 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-66f45741-3b51-40fc-adfd-17f52639f917 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042105 Jul 05 16:13:12.425566 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 310/620] 10.222.0.45 () {60 vars in 1342 bytes} [Tue Jul 5 16:13:12 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 16:13:12.864732 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-aec3c00d-3f1b-40a2-b4df-a25c2ce4cfe7 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:12.865401 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-aec3c00d-3f1b-40a2-b4df-a25c2ce4cfe7 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:12.872594 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-aec3c00d-3f1b-40a2-b4df-a25c2ce4cfe7 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:12.873452 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-aec3c00d-3f1b-40a2-b4df-a25c2ce4cfe7 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:12.874247 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-aec3c00d-3f1b-40a2-b4df-a25c2ce4cfe7 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:12.874693 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-aec3c00d-3f1b-40a2-b4df-a25c2ce4cfe7 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:13.005973 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-aec3c00d-3f1b-40a2-b4df-a25c2ce4cfe7 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:13.013999 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-aec3c00d-3f1b-40a2-b4df-a25c2ce4cfe7 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1734 microversion: 2.1 time: 0.153680 Jul 05 16:13:13.014572 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 311/621] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:12 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:13.436740 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-2adc866a-c0d4-425e-9938-6eaae415666c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:13.437705 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-2adc866a-c0d4-425e-9938-6eaae415666c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:13.444737 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2adc866a-c0d4-425e-9938-6eaae415666c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:13.445252 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2adc866a-c0d4-425e-9938-6eaae415666c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:13.446026 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2adc866a-c0d4-425e-9938-6eaae415666c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:13.446465 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2adc866a-c0d4-425e-9938-6eaae415666c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:13.475470 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-2adc866a-c0d4-425e-9938-6eaae415666c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042813 Jul 05 16:13:13.476074 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 311/622] 10.222.0.45 () {60 vars in 1342 bytes} [Tue Jul 5 16:13:13 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 16:13:14.030752 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-f5b1f67d-f372-4124-91d0-3db217c6272b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:14.031402 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-f5b1f67d-f372-4124-91d0-3db217c6272b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:14.037882 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f5b1f67d-f372-4124-91d0-3db217c6272b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:14.038334 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f5b1f67d-f372-4124-91d0-3db217c6272b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:14.039096 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f5b1f67d-f372-4124-91d0-3db217c6272b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:14.039534 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f5b1f67d-f372-4124-91d0-3db217c6272b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:14.169658 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-f5b1f67d-f372-4124-91d0-3db217c6272b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:14.178051 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-f5b1f67d-f372-4124-91d0-3db217c6272b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1734 microversion: 2.1 time: 0.150604 Jul 05 16:13:14.178614 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 312/623] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:14 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:14.287127 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-f9411f99-e48f-46bc-bffb-511669b4ceec tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:14.287808 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-f9411f99-e48f-46bc-bffb-511669b4ceec tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:14.294391 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f9411f99-e48f-46bc-bffb-511669b4ceec tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:14.294842 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f9411f99-e48f-46bc-bffb-511669b4ceec tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:14.295610 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f9411f99-e48f-46bc-bffb-511669b4ceec tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:14.296049 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f9411f99-e48f-46bc-bffb-511669b4ceec tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:14.430123 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-f9411f99-e48f-46bc-bffb-511669b4ceec tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:14.438181 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-f9411f99-e48f-46bc-bffb-511669b4ceec tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1596 microversion: 2.1 time: 0.154981 Jul 05 16:13:14.438752 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 312/624] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:14 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1596 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:14.487409 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-e9637e46-ffe5-4e7e-b0ae-daa90f4b59c3 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:14.488381 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-e9637e46-ffe5-4e7e-b0ae-daa90f4b59c3 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:14.494952 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e9637e46-ffe5-4e7e-b0ae-daa90f4b59c3 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:14.495391 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e9637e46-ffe5-4e7e-b0ae-daa90f4b59c3 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:14.496364 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e9637e46-ffe5-4e7e-b0ae-daa90f4b59c3 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:14.496852 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e9637e46-ffe5-4e7e-b0ae-daa90f4b59c3 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:14.525318 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-e9637e46-ffe5-4e7e-b0ae-daa90f4b59c3 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042074 Jul 05 16:13:14.525893 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 313/625] 10.222.0.45 () {60 vars in 1342 bytes} [Tue Jul 5 16:13:14 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 16:13:15.195133 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-75a99c96-66bc-49f7-8b1d-a91fec0bd452 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:15.195752 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-75a99c96-66bc-49f7-8b1d-a91fec0bd452 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:15.202265 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-75a99c96-66bc-49f7-8b1d-a91fec0bd452 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:15.202720 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-75a99c96-66bc-49f7-8b1d-a91fec0bd452 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:15.203603 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-75a99c96-66bc-49f7-8b1d-a91fec0bd452 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:15.203939 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-75a99c96-66bc-49f7-8b1d-a91fec0bd452 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:15.343367 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-75a99c96-66bc-49f7-8b1d-a91fec0bd452 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:15.351392 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-75a99c96-66bc-49f7-8b1d-a91fec0bd452 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1714 microversion: 2.1 time: 0.160642 Jul 05 16:13:15.351947 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 313/626] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:15 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1714 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:13:15.454280 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-a55fb8c0-dce1-4d90-871e-8eef4992aec8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:15.454806 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-a55fb8c0-dce1-4d90-871e-8eef4992aec8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:15.461904 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a55fb8c0-dce1-4d90-871e-8eef4992aec8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:15.462352 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a55fb8c0-dce1-4d90-871e-8eef4992aec8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:15.463115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a55fb8c0-dce1-4d90-871e-8eef4992aec8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:15.463545 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a55fb8c0-dce1-4d90-871e-8eef4992aec8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:15.538204 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-c1084bd6-cf9c-4c94-a1c9-a1bc09df89f6 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:15.538745 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:15.539899 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-c1084bd6-cf9c-4c94-a1c9-a1bc09df89f6 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:15.544328 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-a55fb8c0-dce1-4d90-871e-8eef4992aec8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] HTTP exception thrown: Cannot 'detach_volume' instance 42be8657-fc50-4057-b373-e7bcf984e261 while it is in vm_state rescued Jul 05 16:13:15.546043 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-a55fb8c0-dce1-4d90-871e-8eef4992aec8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Request method failure captured: Jul 05 16:13:15.546043 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: DELETE /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261/os-volume_attachments/b93ba52f-6676-4661-8815-bfc20f0eb022 HTTP/1.1 Jul 05 16:13:15.546043 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:13:15.546043 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:13:15.546043 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:13:15.546043 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:13:15.546043 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:13:15.546043 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:13:15.546043 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:13:15.546043 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:13:15.546043 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIbm-fGDoYcXhi-DiBd_EHf54mABU16-lVoqKUsmzMxPfvtZz3cDR_eLFLAUXUkaoXiE_x_JaCy2K0M-p1S_UwLA--ZfDF_Efr5SkiXjg8KEFbKA2u7SIH1VdWaoghMLl3WnWI8g3GmnhK30BicBR2S2x7Pflc_2x-DFM7Iz5W2JHg Jul 05 16:13:15.546043 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:13:15.546043 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:13:15.546043 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:13:15.546043 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:13:15.546043 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:13:15.546043 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:13:15.546043 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: bbe6a2de3cba4aa7b365f30f5b2f745c Jul 05 16:13:15.546043 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1117569186 Jul 05 16:13:15.546043 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:13:15.546043 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:13:15.547385 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bbe6a2de3cba4aa7b365f30f5b2f745c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bbe6a2de3cba4aa7b365f30f5b2f745c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bbe6a2de3cba4aa7b365f30f5b2f745c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bbe6a2de3cba4aa7b365f30f5b2f745c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:13:15.547385 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1117569186 Jul 05 16:13:15.547385 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: bbe6a2de3cba4aa7b365f30f5b2f745c Jul 05 16:13:15.547385 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1117569186 Jul 05 16:13:15.547385 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-ServerRescueNegativeTestJSON-1117569186-project Jul 05 16:13:15.547385 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:13:15.547385 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:13:15.547385 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: 8b6e665914774eabba120e986e6bb282 Jul 05 16:13:15.547385 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1117569186-project Jul 05 16:13:15.547385 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:13:15.547385 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Cannot 'detach_volume' instance 42be8657-fc50-4057-b373-e7bcf984e261 while it is in vm_state rescued Jul 05 16:13:15.548065 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'server_id': '42be8657-fc50-4057-b373-e7bcf984e261', 'id': 'b93ba52f-6676-4661-8815-bfc20f0eb022'} Jul 05 16:13:15.548065 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:13:15.548065 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:13:15.548065 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 05 16:13:15.548065 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 05 16:13:15.548065 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 05 16:13:15.548065 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 05 16:13:15.548065 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 05 16:13:15.548065 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 05 16:13:15.548065 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 42be8657-fc50-4057-b373-e7bcf984e261 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 05 16:13:15.548065 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:13:15.548065 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:13:15.548065 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:13:15.548065 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:13:15.548065 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:13:15.548065 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:13:15.548065 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:13:15.548065 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:13:15.548065 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:13:15.548065 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:13:15.549423 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 05 16:13:15.549423 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 05 16:13:15.549423 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 05 16:13:15.549423 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 05 16:13:15.549423 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 42be8657-fc50-4057-b373-e7bcf984e261 while it is in vm_state rescued Jul 05 16:13:15.549423 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:13:15.549423 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:13:15.549423 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:13:15.549423 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:13:15.549423 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:13:15.549423 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:13:15.549423 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:13:15.549423 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:13:15.549423 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 42be8657-fc50-4057-b373-e7bcf984e261 while it is in vm_state rescued Jul 05 16:13:15.549423 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:13:15.550641 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c1084bd6-cf9c-4c94-a1c9-a1bc09df89f6 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:15.550743 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-a55fb8c0-dce1-4d90-871e-8eef4992aec8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Returning 409 to user: Cannot 'detach_volume' instance 42be8657-fc50-4057-b373-e7bcf984e261 while it is in vm_state rescued {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:13:15.550838 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c1084bd6-cf9c-4c94-a1c9-a1bc09df89f6 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:15.550936 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-a55fb8c0-dce1-4d90-871e-8eef4992aec8 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "DELETE /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261/os-volume_attachments/b93ba52f-6676-4661-8815-bfc20f0eb022" status: 409 len: 152 microversion: 2.1 time: 0.097321 Jul 05 16:13:15.551032 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c1084bd6-cf9c-4c94-a1c9-a1bc09df89f6 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:15.551120 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 314/627] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Jul 5 16:13:15 2022] DELETE /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261/os-volume_attachments/b93ba52f-6676-4661-8815-bfc20f0eb022 => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 05 16:13:15.551633 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c1084bd6-cf9c-4c94-a1c9-a1bc09df89f6 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:15.556743 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-efff7a6c-4f86-4200-b022-f0edc2e2c0c5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:13:15.557430 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-efff7a6c-4f86-4200-b022-f0edc2e2c0c5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:15.564679 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-efff7a6c-4f86-4200-b022-f0edc2e2c0c5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:15.565339 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-efff7a6c-4f86-4200-b022-f0edc2e2c0c5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:15.566501 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-efff7a6c-4f86-4200-b022-f0edc2e2c0c5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:15.566664 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-efff7a6c-4f86-4200-b022-f0edc2e2c0c5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:15.583090 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-c1084bd6-cf9c-4c94-a1c9-a1bc09df89f6 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049698 Jul 05 16:13:15.584387 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 314/628] 10.222.0.45 () {60 vars in 1342 bytes} [Tue Jul 5 16:13:15 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:15.646036 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-a27d3aa9-9eb4-4738-85bd-21925b205833 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:15.646592 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-a27d3aa9-9eb4-4738-85bd-21925b205833 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:15.652642 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a27d3aa9-9eb4-4738-85bd-21925b205833 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:15.658702 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a27d3aa9-9eb4-4738-85bd-21925b205833 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:15.658702 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a27d3aa9-9eb4-4738-85bd-21925b205833 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:15.658702 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a27d3aa9-9eb4-4738-85bd-21925b205833 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:15.679565 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-a27d3aa9-9eb4-4738-85bd-21925b205833 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Going to try to terminate instance {{(pid=118319) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 16:13:15.694058 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:15.816923 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-efff7a6c-4f86-4200-b022-f0edc2e2c0c5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "POST /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261/action" status: 202 len: 0 microversion: 2.1 time: 0.263851 Jul 05 16:13:15.818469 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 315/629] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Jul 5 16:13:15 2022] POST /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 16:13:15.833931 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-d7bb6d75-736f-4377-bd0b-5beaf115e677 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:15.834693 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-d7bb6d75-736f-4377-bd0b-5beaf115e677 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:15.841123 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d7bb6d75-736f-4377-bd0b-5beaf115e677 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:15.841632 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d7bb6d75-736f-4377-bd0b-5beaf115e677 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:15.842346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d7bb6d75-736f-4377-bd0b-5beaf115e677 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:15.842956 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d7bb6d75-736f-4377-bd0b-5beaf115e677 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:15.981748 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-d7bb6d75-736f-4377-bd0b-5beaf115e677 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:15.990935 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-d7bb6d75-736f-4377-bd0b-5beaf115e677 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1722 microversion: 2.1 time: 0.168101 Jul 05 16:13:15.991508 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 316/630] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:15 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:13:16.004795 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-a27d3aa9-9eb4-4738-85bd-21925b205833 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "DELETE /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 204 len: 0 microversion: 2.20 time: 0.362358 Jul 05 16:13:16.005426 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 315/631] 10.222.0.45 () {60 vars in 1279 bytes} [Tue Jul 5 16:13:15 2022] DELETE /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 05 16:13:16.014432 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-b384e398-6f53-4d51-a2a7-160daea11aad tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:16.015073 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-b384e398-6f53-4d51-a2a7-160daea11aad tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:16.021250 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b384e398-6f53-4d51-a2a7-160daea11aad tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:16.021701 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b384e398-6f53-4d51-a2a7-160daea11aad tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:16.022465 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b384e398-6f53-4d51-a2a7-160daea11aad tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:16.022901 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b384e398-6f53-4d51-a2a7-160daea11aad tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:16.151831 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-b384e398-6f53-4d51-a2a7-160daea11aad tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:16.159886 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-b384e398-6f53-4d51-a2a7-160daea11aad tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:16.161426 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-b384e398-6f53-4d51-a2a7-160daea11aad tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:16.163126 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-b384e398-6f53-4d51-a2a7-160daea11aad tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1722 microversion: 2.20 time: 0.152789 Jul 05 16:13:16.163689 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 317/632] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:13:16 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:13:16.694282 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [req-1cdce335-9d5e-4df8-9181-a5ecdf22ce04 req-6eaadcb7-c8e0-4ace-88ab-0fe7fa496d99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7e85e1f-39bb-4c8c-addb-85ae261a3eb7", "tag": "0acdc586-b1e0-458b-8b41-006c61e42c40"}]} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:13:16.703468 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-1cdce335-9d5e-4df8-9181-a5ecdf22ce04 req-6eaadcb7-c8e0-4ace-88ab-0fe7fa496d99 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:16.704173 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-1cdce335-9d5e-4df8-9181-a5ecdf22ce04 req-6eaadcb7-c8e0-4ace-88ab-0fe7fa496d99 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:16.716296 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.compute.server_external_events [req-1cdce335-9d5e-4df8-9181-a5ecdf22ce04 req-6eaadcb7-c8e0-4ace-88ab-0fe7fa496d99 service nova] Creating event network-changed:0acdc586-b1e0-458b-8b41-006c61e42c40 for instance e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 on hv-cinder-84875 Jul 05 16:13:16.721290 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [req-1cdce335-9d5e-4df8-9181-a5ecdf22ce04 req-6eaadcb7-c8e0-4ace-88ab-0fe7fa496d99 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032303 Jul 05 16:13:16.721902 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 316/633] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:13:17.009417 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-4e2667be-de07-4b9a-8496-f77fe2d592db tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:17.010035 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-4e2667be-de07-4b9a-8496-f77fe2d592db tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:17.016295 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4e2667be-de07-4b9a-8496-f77fe2d592db tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:17.016749 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4e2667be-de07-4b9a-8496-f77fe2d592db tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:17.017700 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4e2667be-de07-4b9a-8496-f77fe2d592db tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:17.018147 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4e2667be-de07-4b9a-8496-f77fe2d592db tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:17.183600 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-d0b3b90a-184e-4502-ad46-60eba804e00e tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:17.184305 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-d0b3b90a-184e-4502-ad46-60eba804e00e tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:17.190461 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-4e2667be-de07-4b9a-8496-f77fe2d592db tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:17.190802 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d0b3b90a-184e-4502-ad46-60eba804e00e tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:17.191254 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d0b3b90a-184e-4502-ad46-60eba804e00e tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:17.192035 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d0b3b90a-184e-4502-ad46-60eba804e00e tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:17.192469 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d0b3b90a-184e-4502-ad46-60eba804e00e tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:17.200050 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-4e2667be-de07-4b9a-8496-f77fe2d592db tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1722 microversion: 2.1 time: 0.195207 Jul 05 16:13:17.201102 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 318/634] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:17 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:17.361629 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-d0b3b90a-184e-4502-ad46-60eba804e00e tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:17.370823 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-d0b3b90a-184e-4502-ad46-60eba804e00e tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:17.372902 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-d0b3b90a-184e-4502-ad46-60eba804e00e tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:17.373944 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-d0b3b90a-184e-4502-ad46-60eba804e00e tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1722 microversion: 2.20 time: 0.195375 Jul 05 16:13:17.374721 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 317/635] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:13:17 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:13:18.224861 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-0d40e796-8a51-44ce-8ea7-589a64f00041 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:18.225500 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-0d40e796-8a51-44ce-8ea7-589a64f00041 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:18.235719 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0d40e796-8a51-44ce-8ea7-589a64f00041 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:18.236127 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0d40e796-8a51-44ce-8ea7-589a64f00041 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:18.237451 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0d40e796-8a51-44ce-8ea7-589a64f00041 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:18.238061 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0d40e796-8a51-44ce-8ea7-589a64f00041 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:18.397729 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-51df9c66-4794-4e16-a707-d9687b2aefd7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:18.398460 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-51df9c66-4794-4e16-a707-d9687b2aefd7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:18.406038 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-51df9c66-4794-4e16-a707-d9687b2aefd7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:18.406784 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-51df9c66-4794-4e16-a707-d9687b2aefd7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:18.407965 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-51df9c66-4794-4e16-a707-d9687b2aefd7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:18.408488 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-51df9c66-4794-4e16-a707-d9687b2aefd7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:18.940466 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-0d40e796-8a51-44ce-8ea7-589a64f00041 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:18.949279 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-0d40e796-8a51-44ce-8ea7-589a64f00041 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1722 microversion: 2.1 time: 0.734222 Jul 05 16:13:18.949923 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 319/636] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:18 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1722 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:18.971977 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-51df9c66-4794-4e16-a707-d9687b2aefd7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:18.981802 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-51df9c66-4794-4e16-a707-d9687b2aefd7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:18.983970 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-51df9c66-4794-4e16-a707-d9687b2aefd7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:18.985589 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-51df9c66-4794-4e16-a707-d9687b2aefd7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1722 microversion: 2.20 time: 0.593045 Jul 05 16:13:18.986417 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 318/637] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:13:18 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1722 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:13:19.196976 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-5ca62e6a-9d04-4125-bc96-52c77128ced3 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-485465084"}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:13:19.197520 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-5ca62e6a-9d04-4125-bc96-52c77128ced3 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:19.204269 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5ca62e6a-9d04-4125-bc96-52c77128ced3 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:19.204720 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5ca62e6a-9d04-4125-bc96-52c77128ced3 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:19.205621 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5ca62e6a-9d04-4125-bc96-52c77128ced3 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:19.206108 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5ca62e6a-9d04-4125-bc96-52c77128ced3 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:19.412513 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.network.security_group_api [None req-5ca62e6a-9d04-4125-bc96-52c77128ced3 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Adding security group 193810cf-2e17-46e2-b6c3-5ef68e3c5435 to port 0acdc586-b1e0-458b-8b41-006c61e42c40 Jul 05 16:13:19.604717 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [req-c9aabc3e-9733-48db-9a1e-e47d388d7be7 req-840d81b7-84db-406a-8064-f0cafe183523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da368d38-2642-49c3-b499-eb5a977cbd77", "name": "network-vif-deleted", "tag": "c24636dc-9b24-45b5-a963-180931342e24"}]} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:13:19.619826 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-c9aabc3e-9733-48db-9a1e-e47d388d7be7 req-840d81b7-84db-406a-8064-f0cafe183523 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:19.620515 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-c9aabc3e-9733-48db-9a1e-e47d388d7be7 req-840d81b7-84db-406a-8064-f0cafe183523 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:19.633544 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.compute.server_external_events [req-c9aabc3e-9733-48db-9a1e-e47d388d7be7 req-840d81b7-84db-406a-8064-f0cafe183523 service nova] Creating event network-vif-deleted:c24636dc-9b24-45b5-a963-180931342e24 for instance da368d38-2642-49c3-b499-eb5a977cbd77 on hv-cinder-84875 Jul 05 16:13:19.639648 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [req-c9aabc3e-9733-48db-9a1e-e47d388d7be7 req-840d81b7-84db-406a-8064-f0cafe183523 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038770 Jul 05 16:13:19.640832 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 319/638] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:13:19.941988 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-5ca62e6a-9d04-4125-bc96-52c77128ced3 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "POST /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7/action" status: 202 len: 0 microversion: 2.1 time: 0.749102 Jul 05 16:13:19.943736 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 320/639] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Jul 5 16:13:19 2022] POST /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7/action => generated 0 bytes in 752 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 16:13:19.952679 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-0cdd4f83-9b14-4f83-b6b3-c0e2c25e96fa tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:19.953809 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-0cdd4f83-9b14-4f83-b6b3-c0e2c25e96fa tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:19.967037 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-280559e4-f7ee-45cf-bd87-130579c0005a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:19.967669 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-280559e4-f7ee-45cf-bd87-130579c0005a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:19.978744 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-280559e4-f7ee-45cf-bd87-130579c0005a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:19.978744 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-280559e4-f7ee-45cf-bd87-130579c0005a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:19.978744 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-280559e4-f7ee-45cf-bd87-130579c0005a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:19.979041 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0cdd4f83-9b14-4f83-b6b3-c0e2c25e96fa tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:19.979134 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-280559e4-f7ee-45cf-bd87-130579c0005a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:19.979784 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0cdd4f83-9b14-4f83-b6b3-c0e2c25e96fa tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:19.984756 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0cdd4f83-9b14-4f83-b6b3-c0e2c25e96fa tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:19.985550 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0cdd4f83-9b14-4f83-b6b3-c0e2c25e96fa tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:20.213152 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-280559e4-f7ee-45cf-bd87-130579c0005a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:20.221714 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-280559e4-f7ee-45cf-bd87-130579c0005a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1722 microversion: 2.1 time: 0.258918 Jul 05 16:13:20.222526 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 321/640] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:19 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1722 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:20.228081 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-38972fd1-1264-44d3-b516-59276e124c4b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:20.228705 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-38972fd1-1264-44d3-b516-59276e124c4b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:20.235006 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-38972fd1-1264-44d3-b516-59276e124c4b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:20.235457 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-38972fd1-1264-44d3-b516-59276e124c4b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:20.236224 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-38972fd1-1264-44d3-b516-59276e124c4b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:20.236870 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-38972fd1-1264-44d3-b516-59276e124c4b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:20.241669 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-0cdd4f83-9b14-4f83-b6b3-c0e2c25e96fa tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:20.249903 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-0cdd4f83-9b14-4f83-b6b3-c0e2c25e96fa tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1761 microversion: 2.1 time: 0.301624 Jul 05 16:13:20.256867 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 320/641] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:19 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1761 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:20.270361 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-38972fd1-1264-44d3-b516-59276e124c4b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:20.271357 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-38972fd1-1264-44d3-b516-59276e124c4b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:20.271856 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.objects.instance [None req-38972fd1-1264-44d3-b516-59276e124c4b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lazy-loading 'fault' on Instance uuid da368d38-2642-49c3-b499-eb5a977cbd77 {{(pid=118320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 16:13:20.315165 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-38972fd1-1264-44d3-b516-59276e124c4b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:20.323276 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-38972fd1-1264-44d3-b516-59276e124c4b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:20.324863 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-38972fd1-1264-44d3-b516-59276e124c4b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:20.326159 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-38972fd1-1264-44d3-b516-59276e124c4b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 200 len: 1371 microversion: 2.20 time: 0.102558 Jul 05 16:13:20.326844 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 322/642] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:13:20 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:13:21.240348 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-7f3893a8-3221-474b-826d-3a3b3c276cee tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:21.241018 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-7f3893a8-3221-474b-826d-3a3b3c276cee tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:21.248354 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7f3893a8-3221-474b-826d-3a3b3c276cee tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:21.248820 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7f3893a8-3221-474b-826d-3a3b3c276cee tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:21.249588 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7f3893a8-3221-474b-826d-3a3b3c276cee tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:21.250015 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7f3893a8-3221-474b-826d-3a3b3c276cee tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:21.345036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-74ee9eab-0b4a-42a1-a94b-879e3e1b9d5b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:21.345656 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-74ee9eab-0b4a-42a1-a94b-879e3e1b9d5b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:21.352187 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-74ee9eab-0b4a-42a1-a94b-879e3e1b9d5b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:21.352639 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-74ee9eab-0b4a-42a1-a94b-879e3e1b9d5b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:21.353467 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-74ee9eab-0b4a-42a1-a94b-879e3e1b9d5b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:21.353911 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-74ee9eab-0b4a-42a1-a94b-879e3e1b9d5b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:21.367692 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-74ee9eab-0b4a-42a1-a94b-879e3e1b9d5b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] HTTP exception thrown: Instance da368d38-2642-49c3-b499-eb5a977cbd77 could not be found. Jul 05 16:13:21.369382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-74ee9eab-0b4a-42a1-a94b-879e3e1b9d5b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Request method failure captured: Jul 05 16:13:21.369382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 HTTP/1.1 Jul 05 16:13:21.369382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:13:21.369382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:13:21.369382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:13:21.369382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:13:21.369382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:13:21.369382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:13:21.369382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:13:21.369382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:13:21.369382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIbAzY4m-xw6miW2z6yqGL3_GvI2FNll-taMsHI9kHnc86Pkz8VIEA_zUxPS0MvECalrA1RNhmZWNgqXenoHExZmV8MUlpjmawZTA-boICXZENJy2hmy1lMpn5SQ3TE_vrwTBcKictbAq5kkg2WOnUnoMgaHDurdYGKEt9-AUjkmjA Jul 05 16:13:21.369382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:13:21.369382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:13:21.369382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:13:21.369382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:13:21.369382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Openstack-Nova-Api-Version: 2.20 Jul 05 16:13:21.369382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:13:21.369382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:13:21.369382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: b6acb89542314578839f701251add904 Jul 05 16:13:21.369382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2020590602 Jul 05 16:13:21.369382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:13:21.369382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:13:21.370926 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b6acb89542314578839f701251add904"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b6acb89542314578839f701251add904"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b6acb89542314578839f701251add904"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b6acb89542314578839f701251add904"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:13:21.370926 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2020590602 Jul 05 16:13:21.370926 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: b6acb89542314578839f701251add904 Jul 05 16:13:21.370926 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2020590602 Jul 05 16:13:21.370926 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-AttachVolumeShelveTestJSON-2020590602-project Jul 05 16:13:21.370926 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:13:21.370926 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:13:21.370926 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: cb0474d4e6dd4d2b9918fd0ebe803dcd Jul 05 16:13:21.370926 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2020590602-project Jul 05 16:13:21.370926 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:13:21.370926 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance da368d38-2642-49c3-b499-eb5a977cbd77 could not be found. Jul 05 16:13:21.370926 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': 'da368d38-2642-49c3-b499-eb5a977cbd77'} Jul 05 16:13:21.371855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:13:21.371855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:13:21.371855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:13:21.371855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:13:21.371855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:13:21.371855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:13:21.371855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:13:21.371855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:13:21.371855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:13:21.371855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:13:21.371855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da368d38-2642-49c3-b499-eb5a977cbd77 could not be found. Jul 05 16:13:21.371855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:13:21.371855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:13:21.371855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:13:21.371855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:13:21.371855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:13:21.371855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:13:21.371855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:13:21.371855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:13:21.371855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:13:21.373353 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:13:21.373353 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 16:13:21.373353 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 16:13:21.373353 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:13:21.373353 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:13:21.373353 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:13:21.373353 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:13:21.373353 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da368d38-2642-49c3-b499-eb5a977cbd77 could not be found. Jul 05 16:13:21.373353 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:13:21.373353 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:13:21.373353 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:13:21.373353 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:13:21.373353 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:13:21.373353 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:13:21.373353 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:13:21.373353 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:13:21.373353 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da368d38-2642-49c3-b499-eb5a977cbd77 could not be found. Jul 05 16:13:21.373353 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:13:21.374641 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-74ee9eab-0b4a-42a1-a94b-879e3e1b9d5b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Returning 404 to user: Instance da368d38-2642-49c3-b499-eb5a977cbd77 could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:13:21.374641 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-74ee9eab-0b4a-42a1-a94b-879e3e1b9d5b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 404 len: 111 microversion: 2.20 time: 0.029699 Jul 05 16:13:21.374641 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 323/643] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:13:21 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 05 16:13:21.383754 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-afc3ee89-b3b6-432b-82f5-5ddde7340956 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '.version_select at 0x7f3087cb2430>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:21.389767 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-7f3893a8-3221-474b-826d-3a3b3c276cee tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:21.398237 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-7f3893a8-3221-474b-826d-3a3b3c276cee tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1728 microversion: 2.1 time: 0.162075 Jul 05 16:13:21.398812 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 321/644] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:21 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:21.414774 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-a065d450-7f55-4ea2-91c4-88b6005c69ea tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:21.415258 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-a065d450-7f55-4ea2-91c4-88b6005c69ea tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:21.421060 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a065d450-7f55-4ea2-91c4-88b6005c69ea tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:21.421594 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a065d450-7f55-4ea2-91c4-88b6005c69ea tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:21.422335 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a065d450-7f55-4ea2-91c4-88b6005c69ea tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:21.422767 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a065d450-7f55-4ea2-91c4-88b6005c69ea tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:21.505660 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-a065d450-7f55-4ea2-91c4-88b6005c69ea tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093720 Jul 05 16:13:21.506335 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 322/645] 10.222.0.45 () {58 vars in 1274 bytes} [Tue Jul 5 16:13:21 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:13:21.511369 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-afc3ee89-b3b6-432b-82f5-5ddde7340956 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-387427874" status: 204 len: 0 microversion: 2.20 time: 0.131663 Jul 05 16:13:21.512155 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 324/646] 10.222.0.45 () {60 vars in 1258 bytes} [Tue Jul 5 16:13:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-387427874 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 05 16:13:21.662465 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [req-c0ae7395-fdd6-47bc-a13e-d129c6eada97 req-abe7a35e-a22d-4d0f-8cd9-119ed2b0ebf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7e85e1f-39bb-4c8c-addb-85ae261a3eb7", "tag": "0acdc586-b1e0-458b-8b41-006c61e42c40"}]} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:13:21.670864 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-c0ae7395-fdd6-47bc-a13e-d129c6eada97 req-abe7a35e-a22d-4d0f-8cd9-119ed2b0ebf9 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:21.671316 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-c0ae7395-fdd6-47bc-a13e-d129c6eada97 req-abe7a35e-a22d-4d0f-8cd9-119ed2b0ebf9 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:21.683144 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.compute.server_external_events [req-c0ae7395-fdd6-47bc-a13e-d129c6eada97 req-abe7a35e-a22d-4d0f-8cd9-119ed2b0ebf9 service nova] Creating event network-changed:0acdc586-b1e0-458b-8b41-006c61e42c40 for instance e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 on hv-cinder-84875 Jul 05 16:13:21.688169 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [req-c0ae7395-fdd6-47bc-a13e-d129c6eada97 req-abe7a35e-a22d-4d0f-8cd9-119ed2b0ebf9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030047 Jul 05 16:13:21.688840 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 323/647] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:13:23.003914 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-173963c4-2fa4-46d1-b226-c17932ce6876 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Action: 'create', calling method: .version_select at 0x7f3087c9de50>, body: {"keypair": {"name": "tempest-keypair-600286819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIP8nyp8/LqgepEOlJ+Cf/OeXcBjqguSB3AT3FQ/UVk7Mz1jKyyPRAUBOr7NuBQAqLQLwvMlhYPOfdHDbTat+HkoiEuS5/ViMQEBX+NN5UjKeEI7aiR9PYgAB2MboBAeig=="}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:13:23.018308 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-173963c4-2fa4-46d1-b226-c17932ce6876 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Getting quotas for project b6acb89542314578839f701251add904. Resources: {'key_pairs'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:13:23.022759 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-173963c4-2fa4-46d1-b226-c17932ce6876 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Getting quotas for user cb0474d4e6dd4d2b9918fd0ebe803dcd and project b6acb89542314578839f701251add904. Resources: {'key_pairs'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:13:23.084423 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [req-1e213196-afd4-40d7-ae20-e02490b22e9d req-35d9b9d4-57bb-4860-962b-eeb0a76fb374 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42be8657-fc50-4057-b373-e7bcf984e261", "tag": "81587e02-fcd0-4999-9ed7-aae4729b5548"}]} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:13:23.093057 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-1e213196-afd4-40d7-ae20-e02490b22e9d req-35d9b9d4-57bb-4860-962b-eeb0a76fb374 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:23.099672 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-1e213196-afd4-40d7-ae20-e02490b22e9d req-35d9b9d4-57bb-4860-962b-eeb0a76fb374 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:23.105808 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.compute.server_external_events [req-1e213196-afd4-40d7-ae20-e02490b22e9d req-35d9b9d4-57bb-4860-962b-eeb0a76fb374 service nova] Creating event network-changed:81587e02-fcd0-4999-9ed7-aae4729b5548 for instance 42be8657-fc50-4057-b373-e7bcf984e261 on hv-cinder-84875 Jul 05 16:13:23.113797 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [req-1e213196-afd4-40d7-ae20-e02490b22e9d req-35d9b9d4-57bb-4860-962b-eeb0a76fb374 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034762 Jul 05 16:13:23.117567 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 324/648] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:13:23.124034 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-173963c4-2fa4-46d1-b226-c17932ce6876 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.124649 Jul 05 16:13:23.125022 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 325/649] 10.222.0.45 () {62 vars in 1199 bytes} [Tue Jul 5 16:13:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 126 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 05 16:13:25.130975 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [req-adbe8986-135f-4122-9cd7-c2d06955c04d req-d80e21cf-994d-4d35-b7c6-dd353fab04c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42be8657-fc50-4057-b373-e7bcf984e261", "tag": "81587e02-fcd0-4999-9ed7-aae4729b5548"}]} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:13:25.139111 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-adbe8986-135f-4122-9cd7-c2d06955c04d req-d80e21cf-994d-4d35-b7c6-dd353fab04c4 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:25.139548 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-adbe8986-135f-4122-9cd7-c2d06955c04d req-d80e21cf-994d-4d35-b7c6-dd353fab04c4 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:25.150199 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.compute.server_external_events [req-adbe8986-135f-4122-9cd7-c2d06955c04d req-d80e21cf-994d-4d35-b7c6-dd353fab04c4 service nova] Creating event network-changed:81587e02-fcd0-4999-9ed7-aae4729b5548 for instance 42be8657-fc50-4057-b373-e7bcf984e261 on hv-cinder-84875 Jul 05 16:13:25.155583 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [req-adbe8986-135f-4122-9cd7-c2d06955c04d req-d80e21cf-994d-4d35-b7c6-dd353fab04c4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029191 Jul 05 16:13:25.156170 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 325/650] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:13:25.499601 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-17360d3a-27c0-4a36-b4de-ab7ef92c9e0c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-439729534", "imageRef": "c5805086-2ebd-4742-8185-f79894fef91e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2110daf5-1cfa-4c9d-9065-b33fabf55a66"}], "security_groups": [{"name": "tempest-securitygroup--1183851935"}], "key_name": "tempest-keypair-600286819", "user_data": "}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:13:25.626470 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.network.neutron [None req-17360d3a-27c0-4a36-b4de-ab7ef92c9e0c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] validate_networks() for [('2110daf5-1cfa-4c9d-9065-b33fabf55a66', None, None, None, None, None)] {{(pid=118320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 16:13:26.064089 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-17360d3a-27c0-4a36-b4de-ab7ef92c9e0c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Flavor limits 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 16:13:26.064507 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-17360d3a-27c0-4a36-b4de-ab7ef92c9e0c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Image limits 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 16:13:26.065019 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-17360d3a-27c0-4a36-b4de-ab7ef92c9e0c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Flavor pref 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 16:13:26.065428 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-17360d3a-27c0-4a36-b4de-ab7ef92c9e0c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Image pref 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 16:13:26.065836 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-17360d3a-27c0-4a36-b4de-ab7ef92c9e0c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 16:13:26.074666 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-17360d3a-27c0-4a36-b4de-ab7ef92c9e0c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:26.075106 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-17360d3a-27c0-4a36-b4de-ab7ef92c9e0c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:26.075896 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-17360d3a-27c0-4a36-b4de-ab7ef92c9e0c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:26.076328 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-17360d3a-27c0-4a36-b4de-ab7ef92c9e0c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:26.093286 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-17360d3a-27c0-4a36-b4de-ab7ef92c9e0c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Getting quotas for project b6acb89542314578839f701251add904. Resources: {'ram', 'instances', 'cores'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:13:26.097151 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-17360d3a-27c0-4a36-b4de-ab7ef92c9e0c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Getting quotas for user cb0474d4e6dd4d2b9918fd0ebe803dcd and project b6acb89542314578839f701251add904. Resources: {'ram', 'instances', 'cores'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:13:26.108338 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-17360d3a-27c0-4a36-b4de-ab7ef92c9e0c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Going to run 1 instances... {{(pid=118320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 16:13:26.110818 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-17360d3a-27c0-4a36-b4de-ab7ef92c9e0c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5805086-2ebd-4742-8185-f79894fef91e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 16:13:26.267851 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-17360d3a-27c0-4a36-b4de-ab7ef92c9e0c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.772493 Jul 05 16:13:26.268505 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 326/651] 10.222.0.45 () {62 vars in 1187 bytes} [Tue Jul 5 16:13:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 05 16:13:26.279555 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-60673a4d-aa5b-4893-bc15-0dedd94298b8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:26.280250 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-60673a4d-aa5b-4893-bc15-0dedd94298b8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:26.338260 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-60673a4d-aa5b-4893-bc15-0dedd94298b8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:26.345337 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-60673a4d-aa5b-4893-bc15-0dedd94298b8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:26.346869 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-60673a4d-aa5b-4893-bc15-0dedd94298b8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:26.347958 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-60673a4d-aa5b-4893-bc15-0dedd94298b8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1280 microversion: 2.20 time: 0.072701 Jul 05 16:13:26.348500 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 326/652] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:13:26 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1280 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:13:27.367299 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-29604fdc-6e04-4d97-8cbc-6056c7c9730a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:27.368048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-29604fdc-6e04-4d97-8cbc-6056c7c9730a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:27.374056 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-29604fdc-6e04-4d97-8cbc-6056c7c9730a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:27.374506 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-29604fdc-6e04-4d97-8cbc-6056c7c9730a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:27.375261 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-29604fdc-6e04-4d97-8cbc-6056c7c9730a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:27.375697 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-29604fdc-6e04-4d97-8cbc-6056c7c9730a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:27.437976 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-29604fdc-6e04-4d97-8cbc-6056c7c9730a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:27.446452 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-29604fdc-6e04-4d97-8cbc-6056c7c9730a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:27.448009 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-29604fdc-6e04-4d97-8cbc-6056c7c9730a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:27.449129 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-29604fdc-6e04-4d97-8cbc-6056c7c9730a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1276 microversion: 2.20 time: 0.086683 Jul 05 16:13:27.449691 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 327/653] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:13:27 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1276 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:13:28.467617 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-a323c860-d67b-4213-908c-20b27f8edc14 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:28.468370 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-a323c860-d67b-4213-908c-20b27f8edc14 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:28.477421 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a323c860-d67b-4213-908c-20b27f8edc14 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:28.479068 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a323c860-d67b-4213-908c-20b27f8edc14 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:28.479068 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a323c860-d67b-4213-908c-20b27f8edc14 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:28.479266 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a323c860-d67b-4213-908c-20b27f8edc14 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:28.545448 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-a323c860-d67b-4213-908c-20b27f8edc14 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:28.556261 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-a323c860-d67b-4213-908c-20b27f8edc14 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:28.557894 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-a323c860-d67b-4213-908c-20b27f8edc14 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:28.559042 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-a323c860-d67b-4213-908c-20b27f8edc14 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1338 microversion: 2.20 time: 0.095318 Jul 05 16:13:28.559594 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 327/654] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:13:28 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1338 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:13:29.578886 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-b315db3b-81f2-429b-9f5b-5000b72a0944 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:29.579469 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-b315db3b-81f2-429b-9f5b-5000b72a0944 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:29.587315 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b315db3b-81f2-429b-9f5b-5000b72a0944 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:29.587911 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b315db3b-81f2-429b-9f5b-5000b72a0944 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:29.588799 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b315db3b-81f2-429b-9f5b-5000b72a0944 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:29.589335 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b315db3b-81f2-429b-9f5b-5000b72a0944 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:29.975754 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-b315db3b-81f2-429b-9f5b-5000b72a0944 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:29.983817 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-b315db3b-81f2-429b-9f5b-5000b72a0944 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:29.985681 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-b315db3b-81f2-429b-9f5b-5000b72a0944 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:29.986769 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-b315db3b-81f2-429b-9f5b-5000b72a0944 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1406 microversion: 2.20 time: 0.412038 Jul 05 16:13:29.987328 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 328/655] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:13:29 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1406 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:13:30.208800 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [req-8fe6847e-183b-4be6-b24a-1791c4cd602e req-3b103de0-4f74-4448-9c8b-2d67aa06d730 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33b7b310-f555-460e-a187-4940bb9df69a", "tag": "1ad3c6ce-99b9-4f8a-bbe2-1636e320f9ff"}]} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:13:30.217358 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-8fe6847e-183b-4be6-b24a-1791c4cd602e req-3b103de0-4f74-4448-9c8b-2d67aa06d730 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:30.217799 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-8fe6847e-183b-4be6-b24a-1791c4cd602e req-3b103de0-4f74-4448-9c8b-2d67aa06d730 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:30.230384 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.compute.server_external_events [req-8fe6847e-183b-4be6-b24a-1791c4cd602e req-3b103de0-4f74-4448-9c8b-2d67aa06d730 service nova] Creating event network-changed:1ad3c6ce-99b9-4f8a-bbe2-1636e320f9ff for instance 33b7b310-f555-460e-a187-4940bb9df69a on hv-cinder-84875 Jul 05 16:13:30.235600 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [req-8fe6847e-183b-4be6-b24a-1791c4cd602e req-3b103de0-4f74-4448-9c8b-2d67aa06d730 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031693 Jul 05 16:13:30.236510 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 328/656] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:13:31.003376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-9f34570f-152e-413e-96be-ddba175ba7e7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:31.003991 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-9f34570f-152e-413e-96be-ddba175ba7e7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:31.010463 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9f34570f-152e-413e-96be-ddba175ba7e7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:31.010916 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9f34570f-152e-413e-96be-ddba175ba7e7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:31.011681 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9f34570f-152e-413e-96be-ddba175ba7e7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:31.012118 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9f34570f-152e-413e-96be-ddba175ba7e7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:31.173873 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-9f34570f-152e-413e-96be-ddba175ba7e7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:31.182335 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-9f34570f-152e-413e-96be-ddba175ba7e7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:31.183881 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-9f34570f-152e-413e-96be-ddba175ba7e7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:31.185121 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-9f34570f-152e-413e-96be-ddba175ba7e7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1406 microversion: 2.20 time: 0.185617 Jul 05 16:13:31.185728 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 329/657] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:13:30 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:13:32.203922 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-5521d272-db10-4114-9cad-8cde5a0a57dd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:32.204615 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-5521d272-db10-4114-9cad-8cde5a0a57dd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:32.210795 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-5521d272-db10-4114-9cad-8cde5a0a57dd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:32.211241 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-5521d272-db10-4114-9cad-8cde5a0a57dd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:32.211994 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-5521d272-db10-4114-9cad-8cde5a0a57dd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:32.212427 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-5521d272-db10-4114-9cad-8cde5a0a57dd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:32.338961 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-5521d272-db10-4114-9cad-8cde5a0a57dd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:32.346744 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-5521d272-db10-4114-9cad-8cde5a0a57dd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:32.348252 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-5521d272-db10-4114-9cad-8cde5a0a57dd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:32.349413 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-5521d272-db10-4114-9cad-8cde5a0a57dd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1406 microversion: 2.20 time: 0.150235 Jul 05 16:13:32.349968 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 329/658] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:13:32 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:13:33.367353 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-193ce07f-490c-4b01-88f8-8e8e4909d1ed tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:33.367960 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-193ce07f-490c-4b01-88f8-8e8e4909d1ed tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:33.374408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-193ce07f-490c-4b01-88f8-8e8e4909d1ed tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:33.374849 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-193ce07f-490c-4b01-88f8-8e8e4909d1ed tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:33.375601 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-193ce07f-490c-4b01-88f8-8e8e4909d1ed tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:33.376035 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-193ce07f-490c-4b01-88f8-8e8e4909d1ed tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:33.500678 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-193ce07f-490c-4b01-88f8-8e8e4909d1ed tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:33.509114 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-193ce07f-490c-4b01-88f8-8e8e4909d1ed tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:33.510616 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-193ce07f-490c-4b01-88f8-8e8e4909d1ed tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:33.511708 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-193ce07f-490c-4b01-88f8-8e8e4909d1ed tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1406 microversion: 2.20 time: 0.148414 Jul 05 16:13:33.512270 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 330/659] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:13:33 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:13:34.530410 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-4373e5dc-e623-4e25-89f2-0b1a5a9facb4 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:34.531018 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-4373e5dc-e623-4e25-89f2-0b1a5a9facb4 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:34.537631 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-4373e5dc-e623-4e25-89f2-0b1a5a9facb4 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:34.538082 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-4373e5dc-e623-4e25-89f2-0b1a5a9facb4 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:34.538832 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-4373e5dc-e623-4e25-89f2-0b1a5a9facb4 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:34.539261 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-4373e5dc-e623-4e25-89f2-0b1a5a9facb4 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:34.671122 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-4373e5dc-e623-4e25-89f2-0b1a5a9facb4 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:34.676333 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-d28f419b-e7f6-4075-ba2f-96295da8ad0c tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:34.677416 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-d28f419b-e7f6-4075-ba2f-96295da8ad0c tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:34.679446 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-4373e5dc-e623-4e25-89f2-0b1a5a9facb4 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:34.681038 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-4373e5dc-e623-4e25-89f2-0b1a5a9facb4 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:34.682176 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-4373e5dc-e623-4e25-89f2-0b1a5a9facb4 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1406 microversion: 2.20 time: 0.155789 Jul 05 16:13:34.682741 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 330/660] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:13:34 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:13:34.683825 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d28f419b-e7f6-4075-ba2f-96295da8ad0c tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:34.684276 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d28f419b-e7f6-4075-ba2f-96295da8ad0c tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:34.685071 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d28f419b-e7f6-4075-ba2f-96295da8ad0c tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:34.685510 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d28f419b-e7f6-4075-ba2f-96295da8ad0c tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:34.714877 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-d28f419b-e7f6-4075-ba2f-96295da8ad0c tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042405 Jul 05 16:13:34.715446 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 331/661] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Jul 5 16:13:34 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 05 16:13:34.772022 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-10730b21-09ee-418a-ad84-dce43de44179 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:34.772523 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-10730b21-09ee-418a-ad84-dce43de44179 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:34.778548 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-10730b21-09ee-418a-ad84-dce43de44179 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:34.779523 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-10730b21-09ee-418a-ad84-dce43de44179 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:34.779765 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-10730b21-09ee-418a-ad84-dce43de44179 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:34.780202 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-10730b21-09ee-418a-ad84-dce43de44179 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:34.804797 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-10730b21-09ee-418a-ad84-dce43de44179 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Going to try to terminate instance {{(pid=118319) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 16:13:35.063638 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-10730b21-09ee-418a-ad84-dce43de44179 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 204 len: 0 microversion: 2.1 time: 0.295819 Jul 05 16:13:35.064173 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 331/662] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Jul 5 16:13:34 2022] DELETE /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 16:13:35.072993 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-3ed584f8-d8ac-45cb-a598-cdd0f781a82b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:35.073598 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-3ed584f8-d8ac-45cb-a598-cdd0f781a82b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:35.079506 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3ed584f8-d8ac-45cb-a598-cdd0f781a82b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:35.079993 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3ed584f8-d8ac-45cb-a598-cdd0f781a82b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:35.080750 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3ed584f8-d8ac-45cb-a598-cdd0f781a82b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:35.081209 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3ed584f8-d8ac-45cb-a598-cdd0f781a82b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:35.210927 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-3ed584f8-d8ac-45cb-a598-cdd0f781a82b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:35.218610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-3ed584f8-d8ac-45cb-a598-cdd0f781a82b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1671 microversion: 2.1 time: 0.149453 Jul 05 16:13:35.219181 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 332/663] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:35 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:35.701347 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-42b401f0-a192-4d98-b1de-bb5bc3330b39 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:35.702071 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-42b401f0-a192-4d98-b1de-bb5bc3330b39 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:35.709251 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-42b401f0-a192-4d98-b1de-bb5bc3330b39 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:35.709696 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-42b401f0-a192-4d98-b1de-bb5bc3330b39 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:35.710496 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-42b401f0-a192-4d98-b1de-bb5bc3330b39 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:35.710927 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-42b401f0-a192-4d98-b1de-bb5bc3330b39 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:35.845887 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-42b401f0-a192-4d98-b1de-bb5bc3330b39 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:35.854424 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-42b401f0-a192-4d98-b1de-bb5bc3330b39 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:35.855922 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-42b401f0-a192-4d98-b1de-bb5bc3330b39 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:35.857045 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-42b401f0-a192-4d98-b1de-bb5bc3330b39 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1406 microversion: 2.20 time: 0.160215 Jul 05 16:13:35.857805 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 332/664] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:13:35 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:13:35.904365 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-19f4606d-37c0-4638-aa93-3e0c7f1a7abb req-c0f40d0a-9220-4566-9842-2a2261b3c423 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33b7b310-f555-460e-a187-4940bb9df69a", "name": "network-vif-plugged", "status": "completed", "tag": "1ad3c6ce-99b9-4f8a-bbe2-1636e320f9ff"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:13:35.912965 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-19f4606d-37c0-4638-aa93-3e0c7f1a7abb req-c0f40d0a-9220-4566-9842-2a2261b3c423 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:35.913290 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-19f4606d-37c0-4638-aa93-3e0c7f1a7abb req-c0f40d0a-9220-4566-9842-2a2261b3c423 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:35.924086 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-19f4606d-37c0-4638-aa93-3e0c7f1a7abb req-c0f40d0a-9220-4566-9842-2a2261b3c423 service nova] Creating event network-vif-plugged:1ad3c6ce-99b9-4f8a-bbe2-1636e320f9ff for instance 33b7b310-f555-460e-a187-4940bb9df69a on hv-cinder-84875 Jul 05 16:13:35.929662 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-19f4606d-37c0-4638-aa93-3e0c7f1a7abb req-c0f40d0a-9220-4566-9842-2a2261b3c423 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028976 Jul 05 16:13:35.930251 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 333/665] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:13:36.235730 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-cf43d93f-997d-4c19-8842-422e0c2f4ba6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:36.236341 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-cf43d93f-997d-4c19-8842-422e0c2f4ba6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:36.242591 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cf43d93f-997d-4c19-8842-422e0c2f4ba6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:36.243036 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cf43d93f-997d-4c19-8842-422e0c2f4ba6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:36.243792 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cf43d93f-997d-4c19-8842-422e0c2f4ba6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:36.244224 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cf43d93f-997d-4c19-8842-422e0c2f4ba6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:36.342679 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell0:SELECT=2 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:36.373870 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-cf43d93f-997d-4c19-8842-422e0c2f4ba6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:36.381592 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-cf43d93f-997d-4c19-8842-422e0c2f4ba6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1671 microversion: 2.1 time: 0.150046 Jul 05 16:13:36.382147 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 333/666] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:36 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:36.872934 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell0:SELECT=2 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:36.873707 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell0:SELECT=10 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:36.877901 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-f5b09ddd-60dd-4fd0-9f63-f189223fb3be tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:36.878611 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-f5b09ddd-60dd-4fd0-9f63-f189223fb3be tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:36.885370 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f5b09ddd-60dd-4fd0-9f63-f189223fb3be tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:36.885831 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f5b09ddd-60dd-4fd0-9f63-f189223fb3be tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:36.886595 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f5b09ddd-60dd-4fd0-9f63-f189223fb3be tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:36.887037 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f5b09ddd-60dd-4fd0-9f63-f189223fb3be tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:36.901317 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:37.034223 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-f5b09ddd-60dd-4fd0-9f63-f189223fb3be tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:37.042926 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-f5b09ddd-60dd-4fd0-9f63-f189223fb3be tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:37.044533 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-f5b09ddd-60dd-4fd0-9f63-f189223fb3be tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:37.045590 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-f5b09ddd-60dd-4fd0-9f63-f189223fb3be tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1406 microversion: 2.20 time: 0.173641 Jul 05 16:13:37.046159 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 334/667] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:13:36 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:13:37.400041 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-547b6ae0-bade-4529-a855-fcb0b4c3c79d tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:37.400654 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-547b6ae0-bade-4529-a855-fcb0b4c3c79d tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:37.407397 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-547b6ae0-bade-4529-a855-fcb0b4c3c79d tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:37.409792 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-547b6ae0-bade-4529-a855-fcb0b4c3c79d tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:37.409792 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-547b6ae0-bade-4529-a855-fcb0b4c3c79d tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:37.409792 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-547b6ae0-bade-4529-a855-fcb0b4c3c79d tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:37.653748 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-547b6ae0-bade-4529-a855-fcb0b4c3c79d tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:37.657139 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:37.662033 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-547b6ae0-bade-4529-a855-fcb0b4c3c79d tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1671 microversion: 2.1 time: 0.265872 Jul 05 16:13:37.662606 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 334/668] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:37 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1671 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:38.063849 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-188e7778-32a7-41de-841f-09047989f8c3 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:38.065806 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-188e7778-32a7-41de-841f-09047989f8c3 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:38.073318 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-188e7778-32a7-41de-841f-09047989f8c3 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:38.073769 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-188e7778-32a7-41de-841f-09047989f8c3 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:38.074550 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-188e7778-32a7-41de-841f-09047989f8c3 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:38.075019 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-188e7778-32a7-41de-841f-09047989f8c3 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:38.288620 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-188e7778-32a7-41de-841f-09047989f8c3 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:38.297221 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-188e7778-32a7-41de-841f-09047989f8c3 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:38.298748 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-188e7778-32a7-41de-841f-09047989f8c3 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:38.299913 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-188e7778-32a7-41de-841f-09047989f8c3 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1406 microversion: 2.20 time: 0.240026 Jul 05 16:13:38.300479 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 335/669] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:13:38 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:13:38.407133 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [req-1433f5e4-05e3-4ede-98e3-0eb0639f90d0 req-06fc496f-92ad-4b10-b10c-5bcfe0d4ebd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b902cfe-0e0b-4ce5-b2df-67ca0464da74", "name": "network-vif-deleted", "tag": "08ca39e5-59e1-4f7a-887b-ceb7fc9c4671"}]} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:13:38.422353 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-1433f5e4-05e3-4ede-98e3-0eb0639f90d0 req-06fc496f-92ad-4b10-b10c-5bcfe0d4ebd0 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:38.422647 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-1433f5e4-05e3-4ede-98e3-0eb0639f90d0 req-06fc496f-92ad-4b10-b10c-5bcfe0d4ebd0 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:38.435552 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.compute.server_external_events [req-1433f5e4-05e3-4ede-98e3-0eb0639f90d0 req-06fc496f-92ad-4b10-b10c-5bcfe0d4ebd0 service nova] Creating event network-vif-deleted:08ca39e5-59e1-4f7a-887b-ceb7fc9c4671 for instance 9b902cfe-0e0b-4ce5-b2df-67ca0464da74 on hv-cinder-84875 Jul 05 16:13:38.440719 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [req-1433f5e4-05e3-4ede-98e3-0eb0639f90d0 req-06fc496f-92ad-4b10-b10c-5bcfe0d4ebd0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037208 Jul 05 16:13:38.441589 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 335/670] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:13:38.679620 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-da17597b-cfd4-4a0e-b5c5-fcc80f5b9443 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:38.680237 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-da17597b-cfd4-4a0e-b5c5-fcc80f5b9443 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:38.682199 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:38.687053 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-da17597b-cfd4-4a0e-b5c5-fcc80f5b9443 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:38.689458 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-da17597b-cfd4-4a0e-b5c5-fcc80f5b9443 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:38.689458 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-da17597b-cfd4-4a0e-b5c5-fcc80f5b9443 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:38.689458 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-da17597b-cfd4-4a0e-b5c5-fcc80f5b9443 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:38.755898 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-da17597b-cfd4-4a0e-b5c5-fcc80f5b9443 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:38.763578 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-da17597b-cfd4-4a0e-b5c5-fcc80f5b9443 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1322 microversion: 2.1 time: 0.087889 Jul 05 16:13:38.764225 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 336/671] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:38 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1322 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:39.318676 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-fcd75537-4d25-4633-a2d4-175cb91f85a2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:39.319379 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-fcd75537-4d25-4633-a2d4-175cb91f85a2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:39.326490 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fcd75537-4d25-4633-a2d4-175cb91f85a2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:39.329566 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fcd75537-4d25-4633-a2d4-175cb91f85a2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:39.329566 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fcd75537-4d25-4633-a2d4-175cb91f85a2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:39.329566 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-fcd75537-4d25-4633-a2d4-175cb91f85a2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:39.460049 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-fcd75537-4d25-4633-a2d4-175cb91f85a2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:39.469057 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-fcd75537-4d25-4633-a2d4-175cb91f85a2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:39.470578 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-fcd75537-4d25-4633-a2d4-175cb91f85a2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:39.471738 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-fcd75537-4d25-4633-a2d4-175cb91f85a2 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1597 microversion: 2.20 time: 0.157500 Jul 05 16:13:39.474714 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 336/672] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:13:39 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1597 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:13:39.490684 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-1ea7d259-195e-4894-9062-fe163d4ac57d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:39.491207 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-1ea7d259-195e-4894-9062-fe163d4ac57d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:39.498072 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1ea7d259-195e-4894-9062-fe163d4ac57d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:39.498515 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1ea7d259-195e-4894-9062-fe163d4ac57d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:39.499265 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1ea7d259-195e-4894-9062-fe163d4ac57d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:39.499694 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1ea7d259-195e-4894-9062-fe163d4ac57d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:39.573717 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-1ea7d259-195e-4894-9062-fe163d4ac57d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.087628 Jul 05 16:13:39.574315 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 337/673] 10.222.0.45 () {60 vars in 1315 bytes} [Tue Jul 5 16:13:39 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 05 16:13:39.781018 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-6398944c-161a-4c78-a941-83066fae0387 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:39.781778 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-6398944c-161a-4c78-a941-83066fae0387 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:39.788538 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-6398944c-161a-4c78-a941-83066fae0387 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:39.789002 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-6398944c-161a-4c78-a941-83066fae0387 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:39.789710 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-6398944c-161a-4c78-a941-83066fae0387 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:39.790144 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-6398944c-161a-4c78-a941-83066fae0387 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:39.822744 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-6398944c-161a-4c78-a941-83066fae0387 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:39.823089 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-6398944c-161a-4c78-a941-83066fae0387 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:39.823725 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.objects.instance [None req-6398944c-161a-4c78-a941-83066fae0387 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lazy-loading 'fault' on Instance uuid 9b902cfe-0e0b-4ce5-b2df-67ca0464da74 {{(pid=118319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 16:13:39.900239 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-6398944c-161a-4c78-a941-83066fae0387 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:39.907823 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-6398944c-161a-4c78-a941-83066fae0387 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 200 len: 1327 microversion: 2.1 time: 0.131032 Jul 05 16:13:39.908390 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 337/674] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:39 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 1327 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:40.556920 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-4d638957-3a53-41fa-b507-a78aeaaad058 req-78cb2819-4576-4bc5-9fc9-e6f123d4c07b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33b7b310-f555-460e-a187-4940bb9df69a", "tag": "1ad3c6ce-99b9-4f8a-bbe2-1636e320f9ff"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:13:40.565043 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-4d638957-3a53-41fa-b507-a78aeaaad058 req-78cb2819-4576-4bc5-9fc9-e6f123d4c07b service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:40.565600 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-4d638957-3a53-41fa-b507-a78aeaaad058 req-78cb2819-4576-4bc5-9fc9-e6f123d4c07b service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:40.577558 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-4d638957-3a53-41fa-b507-a78aeaaad058 req-78cb2819-4576-4bc5-9fc9-e6f123d4c07b service nova] Creating event network-changed:1ad3c6ce-99b9-4f8a-bbe2-1636e320f9ff for instance 33b7b310-f555-460e-a187-4940bb9df69a on hv-cinder-84875 Jul 05 16:13:40.582404 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-4d638957-3a53-41fa-b507-a78aeaaad058 req-78cb2819-4576-4bc5-9fc9-e6f123d4c07b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030227 Jul 05 16:13:40.583021 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 338/675] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:13:40.933052 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-737d2358-aa49-43c1-a246-e369a120e208 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:40.933878 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-737d2358-aa49-43c1-a246-e369a120e208 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:40.941231 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-737d2358-aa49-43c1-a246-e369a120e208 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:40.941805 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-737d2358-aa49-43c1-a246-e369a120e208 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:40.942755 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-737d2358-aa49-43c1-a246-e369a120e208 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:40.943340 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-737d2358-aa49-43c1-a246-e369a120e208 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:40.957843 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.wsgi [None req-737d2358-aa49-43c1-a246-e369a120e208 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] HTTP exception thrown: Instance 9b902cfe-0e0b-4ce5-b2df-67ca0464da74 could not be found. Jul 05 16:13:40.959777 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-737d2358-aa49-43c1-a246-e369a120e208 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Request method failure captured: Jul 05 16:13:40.959777 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: request: GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 HTTP/1.1 Jul 05 16:13:40.959777 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Accept: application/json Jul 05 16:13:40.959777 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Accept-Encoding: identity Jul 05 16:13:40.959777 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Connection: close Jul 05 16:13:40.959777 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Content-Length: 0 Jul 05 16:13:40.959777 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Content-Type: application/json Jul 05 16:13:40.959777 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Host: 10.222.0.45 Jul 05 16:13:40.959777 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Openstack-System-Scope: None Jul 05 16:13:40.959777 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: User-Agent: python-urllib3/1.26.9 Jul 05 16:13:40.959777 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Auth-Token: gAAAAABixGIXkYoYC5OUwlwwwcN4lQebGZCDv39VJouOlBDL-ZM0IwO2NZWFjFw3CBRHJ9oZWGpw0SIJHD_3yUkxhSGoEoZ2f5SafYhKjPNSYWjCCpBNrrOpFH3EzbYoOd1JFjSWmJwf_VIM07567DnvlGW6gjYXvlrQcYGemTNCHBf3LVZpT4s Jul 05 16:13:40.959777 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Domain-Id: None Jul 05 16:13:40.959777 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Domain-Name: None Jul 05 16:13:40.959777 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Identity-Status: Confirmed Jul 05 16:13:40.959777 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Is-Admin-Project: True Jul 05 16:13:40.959777 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Domain-Id: default Jul 05 16:13:40.959777 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Domain-Name: Default Jul 05 16:13:40.959777 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Id: 3ec37a457530439b8728dd2ad2b6b7bd Jul 05 16:13:40.959777 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Project-Name: tempest-AttachVolumeTestJSON-187031460 Jul 05 16:13:40.959777 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Role: reader,member Jul 05 16:13:40.959777 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Roles: reader,member Jul 05 16:13:40.961408 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3ec37a457530439b8728dd2ad2b6b7bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3ec37a457530439b8728dd2ad2b6b7bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3ec37a457530439b8728dd2ad2b6b7bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3ec37a457530439b8728dd2ad2b6b7bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:13:40.961408 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Tenant: tempest-AttachVolumeTestJSON-187031460 Jul 05 16:13:40.961408 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Tenant-Id: 3ec37a457530439b8728dd2ad2b6b7bd Jul 05 16:13:40.961408 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-Tenant-Name: tempest-AttachVolumeTestJSON-187031460 Jul 05 16:13:40.961408 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User: tempest-AttachVolumeTestJSON-187031460-project Jul 05 16:13:40.961408 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Domain-Id: default Jul 05 16:13:40.961408 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Domain-Name: Default Jul 05 16:13:40.961408 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Id: d7e2fc1ec676438392d7925b43b806f5 Jul 05 16:13:40.961408 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: X-User-Name: tempest-AttachVolumeTestJSON-187031460-project Jul 05 16:13:40.961408 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: method: > Jul 05 16:13:40.961408 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: exception: Instance 9b902cfe-0e0b-4ce5-b2df-67ca0464da74 could not be found. Jul 05 16:13:40.961408 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: action_args: {'id': '9b902cfe-0e0b-4ce5-b2df-67ca0464da74'} Jul 05 16:13:40.962332 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:13:40.962332 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:13:40.962332 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:13:40.962332 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:13:40.962332 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:13:40.962332 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:13:40.962332 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:13:40.962332 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:13:40.962332 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:13:40.962332 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:13:40.962332 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b902cfe-0e0b-4ce5-b2df-67ca0464da74 could not be found. Jul 05 16:13:40.962332 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:13:40.962332 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:13:40.962332 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:13:40.962332 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:13:40.962332 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:13:40.962332 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:13:40.962332 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:13:40.962332 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:13:40.962332 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:13:40.963805 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:13:40.963805 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 16:13:40.963805 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 16:13:40.963805 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:13:40.963805 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:13:40.963805 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:13:40.963805 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:13:40.963805 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b902cfe-0e0b-4ce5-b2df-67ca0464da74 could not be found. Jul 05 16:13:40.963805 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:13:40.963805 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:13:40.963805 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:13:40.963805 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:13:40.963805 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:13:40.963805 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:13:40.963805 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:13:40.963805 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:13:40.963805 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b902cfe-0e0b-4ce5-b2df-67ca0464da74 could not be found. Jul 05 16:13:40.963805 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: ERROR nova.api.openstack.wsgi Jul 05 16:13:40.965235 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-737d2358-aa49-43c1-a246-e369a120e208 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Returning 404 to user: Instance 9b902cfe-0e0b-4ce5-b2df-67ca0464da74 could not be found. {{(pid=118319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:13:40.965997 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-737d2358-aa49-43c1-a246-e369a120e208 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 404 len: 111 microversion: 2.1 time: 0.037039 Jul 05 16:13:40.966684 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 338/676] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:40 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 16:13:40.977768 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-d0dc4868-2f84-4a99-a039-2de0463135f9 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '.version_select at 0x7f3087d5be50>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:41.059405 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-d0dc4868-2f84-4a99-a039-2de0463135f9 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1765971067" status: 202 len: 0 microversion: 2.1 time: 0.087432 Jul 05 16:13:41.060001 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 339/677] 10.222.0.45 () {58 vars in 1220 bytes} [Tue Jul 5 16:13:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1765971067 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 16:13:41.889617 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-634b247c-de9b-4cda-b607-2dff5c7b8ee6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Action: 'create', calling method: .version_select at 0x7f3087f0b820>, body: {"keypair": {"name": "tempest-keypair-2022313536", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZsDFZKWs7x+o1pMruVG5cIZdViy+sfjIew1Sg0ymKzyyuYqsrO1ejLjrk98QNVsS/671plMA7ox8eq3iJSGP+YOZSPF35vb1CyinamfMyS6nMoN+I9+8F3KJn14pPZ4w=="}} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:13:41.903274 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.quota [None req-634b247c-de9b-4cda-b607-2dff5c7b8ee6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Getting quotas for project 3ec37a457530439b8728dd2ad2b6b7bd. Resources: {'key_pairs'} {{(pid=118319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:13:41.907323 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.quota [None req-634b247c-de9b-4cda-b607-2dff5c7b8ee6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Getting quotas for user d7e2fc1ec676438392d7925b43b806f5 and project 3ec37a457530439b8728dd2ad2b6b7bd. Resources: {'key_pairs'} {{(pid=118319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:13:42.004146 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-634b247c-de9b-4cda-b607-2dff5c7b8ee6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.118349 Jul 05 16:13:42.004746 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 339/678] 10.222.0.45 () {60 vars in 1158 bytes} [Tue Jul 5 16:13:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:13:42.921938 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-d6ac3b11-bff3-4952-b2ca-0af234c5c216 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:13:42.922989 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-d6ac3b11-bff3-4952-b2ca-0af234c5c216 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:42.929940 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d6ac3b11-bff3-4952-b2ca-0af234c5c216 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:42.930303 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d6ac3b11-bff3-4952-b2ca-0af234c5c216 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:42.931061 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d6ac3b11-bff3-4952-b2ca-0af234c5c216 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:42.931497 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d6ac3b11-bff3-4952-b2ca-0af234c5c216 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:43.104902 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-d6ac3b11-bff3-4952-b2ca-0af234c5c216 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "POST /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7/action" status: 202 len: 0 microversion: 2.1 time: 0.187037 Jul 05 16:13:43.106987 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 340/679] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Jul 5 16:13:42 2022] POST /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 16:13:43.114903 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-e4c8b23a-ff7f-41b8-ad53-e06adc1c43ec tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:43.117037 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-e4c8b23a-ff7f-41b8-ad53-e06adc1c43ec tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:43.124416 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e4c8b23a-ff7f-41b8-ad53-e06adc1c43ec tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:43.125016 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e4c8b23a-ff7f-41b8-ad53-e06adc1c43ec tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:43.125874 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e4c8b23a-ff7f-41b8-ad53-e06adc1c43ec tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:43.126364 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e4c8b23a-ff7f-41b8-ad53-e06adc1c43ec tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:43.346864 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-e4c8b23a-ff7f-41b8-ad53-e06adc1c43ec tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:43.355848 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-e4c8b23a-ff7f-41b8-ad53-e06adc1c43ec tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1753 microversion: 2.1 time: 0.246049 Jul 05 16:13:43.356512 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 340/680] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:43 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1753 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:44.111468 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-c3d46092-f347-47d8-af8c-60d5a7df53bb tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-158305793", "imageRef": "c5805086-2ebd-4742-8185-f79894fef91e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "77e226ae-740f-49bf-a51d-1fc557b375c9"}], "security_groups": [{"name": "tempest-securitygroup--503417460"}], "key_name": "tempest-keypair-2022313536", "user_data": "}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:13:44.371825 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.network.neutron [None req-c3d46092-f347-47d8-af8c-60d5a7df53bb tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] validate_networks() for [('77e226ae-740f-49bf-a51d-1fc557b375c9', None, None, None, None, None)] {{(pid=118320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 16:13:44.373953 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-223c2e66-0fcf-4991-b3cd-507de6823002 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:44.374569 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-223c2e66-0fcf-4991-b3cd-507de6823002 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:44.378060 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:44.382381 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-223c2e66-0fcf-4991-b3cd-507de6823002 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:44.382835 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-223c2e66-0fcf-4991-b3cd-507de6823002 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:44.383596 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-223c2e66-0fcf-4991-b3cd-507de6823002 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:44.384032 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-223c2e66-0fcf-4991-b3cd-507de6823002 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:44.709377 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-223c2e66-0fcf-4991-b3cd-507de6823002 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:44.717387 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-223c2e66-0fcf-4991-b3cd-507de6823002 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1758 microversion: 2.1 time: 0.347257 Jul 05 16:13:44.717956 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 341/681] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:44 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1758 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:13:44.813533 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-c3d46092-f347-47d8-af8c-60d5a7df53bb tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Flavor limits 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 16:13:44.813956 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-c3d46092-f347-47d8-af8c-60d5a7df53bb tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Image limits 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 16:13:44.814428 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-c3d46092-f347-47d8-af8c-60d5a7df53bb tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Flavor pref 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 16:13:44.814849 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-c3d46092-f347-47d8-af8c-60d5a7df53bb tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Image pref 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 16:13:44.815259 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-c3d46092-f347-47d8-af8c-60d5a7df53bb tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 16:13:44.824472 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c3d46092-f347-47d8-af8c-60d5a7df53bb tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:44.824955 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c3d46092-f347-47d8-af8c-60d5a7df53bb tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:44.825737 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c3d46092-f347-47d8-af8c-60d5a7df53bb tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:44.826167 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c3d46092-f347-47d8-af8c-60d5a7df53bb tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:44.842297 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-c3d46092-f347-47d8-af8c-60d5a7df53bb tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Getting quotas for project 3ec37a457530439b8728dd2ad2b6b7bd. Resources: {'ram', 'instances', 'cores'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:13:44.846008 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-c3d46092-f347-47d8-af8c-60d5a7df53bb tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Getting quotas for user d7e2fc1ec676438392d7925b43b806f5 and project 3ec37a457530439b8728dd2ad2b6b7bd. Resources: {'ram', 'instances', 'cores'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:13:44.856455 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-c3d46092-f347-47d8-af8c-60d5a7df53bb tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Going to run 1 instances... {{(pid=118320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 16:13:44.858763 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-c3d46092-f347-47d8-af8c-60d5a7df53bb tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5805086-2ebd-4742-8185-f79894fef91e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 16:13:44.997645 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-c3d46092-f347-47d8-af8c-60d5a7df53bb tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.891496 Jul 05 16:13:44.998414 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 341/682] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Jul 5 16:13:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 16:13:45.008879 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-f1973ee7-65f4-492d-9e59-c8cf043b025b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:45.009572 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-f1973ee7-65f4-492d-9e59-c8cf043b025b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:45.062184 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-f1973ee7-65f4-492d-9e59-c8cf043b025b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:45.069612 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-f1973ee7-65f4-492d-9e59-c8cf043b025b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66" status: 200 len: 1237 microversion: 2.1 time: 0.065005 Jul 05 16:13:45.070080 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 342/683] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:45 2022] GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:45.735279 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-721c6bc4-501c-489a-be95-691b425d13ae tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:45.735898 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-721c6bc4-501c-489a-be95-691b425d13ae tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:45.744063 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-721c6bc4-501c-489a-be95-691b425d13ae tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:45.744514 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-721c6bc4-501c-489a-be95-691b425d13ae tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:45.745354 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-721c6bc4-501c-489a-be95-691b425d13ae tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:45.745797 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-721c6bc4-501c-489a-be95-691b425d13ae tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:45.891182 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-721c6bc4-501c-489a-be95-691b425d13ae tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:45.899502 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-721c6bc4-501c-489a-be95-691b425d13ae tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1758 microversion: 2.1 time: 0.168539 Jul 05 16:13:45.900070 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 342/684] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:45 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:13:46.086223 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-f0a47cdb-07bb-4a5d-b4c8-4e9413150cde tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:46.086746 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-f0a47cdb-07bb-4a5d-b4c8-4e9413150cde tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:46.093363 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f0a47cdb-07bb-4a5d-b4c8-4e9413150cde tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:46.093811 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f0a47cdb-07bb-4a5d-b4c8-4e9413150cde tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:46.094566 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f0a47cdb-07bb-4a5d-b4c8-4e9413150cde tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:46.095003 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f0a47cdb-07bb-4a5d-b4c8-4e9413150cde tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:46.155804 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-f0a47cdb-07bb-4a5d-b4c8-4e9413150cde tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:46.163986 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-f0a47cdb-07bb-4a5d-b4c8-4e9413150cde tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66" status: 200 len: 1241 microversion: 2.1 time: 0.081700 Jul 05 16:13:46.164552 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 343/685] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:46 2022] GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:46.917123 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-758f3845-705b-40ba-b35f-64ad265f6323 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:46.917766 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-758f3845-705b-40ba-b35f-64ad265f6323 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:46.923979 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-758f3845-705b-40ba-b35f-64ad265f6323 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:46.924431 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-758f3845-705b-40ba-b35f-64ad265f6323 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:46.925215 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-758f3845-705b-40ba-b35f-64ad265f6323 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:46.925648 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-758f3845-705b-40ba-b35f-64ad265f6323 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:47.131053 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-758f3845-705b-40ba-b35f-64ad265f6323 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:47.138974 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-758f3845-705b-40ba-b35f-64ad265f6323 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1758 microversion: 2.1 time: 0.225765 Jul 05 16:13:47.139545 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 343/686] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:46 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1758 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:47.181252 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-e9338b49-b30c-4241-93ce-fb9a6d96f097 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:47.181794 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-e9338b49-b30c-4241-93ce-fb9a6d96f097 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:47.188107 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e9338b49-b30c-4241-93ce-fb9a6d96f097 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:47.188548 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e9338b49-b30c-4241-93ce-fb9a6d96f097 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:47.199466 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e9338b49-b30c-4241-93ce-fb9a6d96f097 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:47.199466 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e9338b49-b30c-4241-93ce-fb9a6d96f097 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:47.258645 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-e9338b49-b30c-4241-93ce-fb9a6d96f097 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:47.266311 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-e9338b49-b30c-4241-93ce-fb9a6d96f097 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66" status: 200 len: 1307 microversion: 2.1 time: 0.089467 Jul 05 16:13:47.266800 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 344/687] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:47 2022] GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 => generated 1307 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:48.155528 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-770cd544-ba64-4651-b939-95fe571f61f8 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:48.156260 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-770cd544-ba64-4651-b939-95fe571f61f8 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:48.163293 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-770cd544-ba64-4651-b939-95fe571f61f8 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:48.163826 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-770cd544-ba64-4651-b939-95fe571f61f8 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:48.164693 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-770cd544-ba64-4651-b939-95fe571f61f8 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:48.165199 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-770cd544-ba64-4651-b939-95fe571f61f8 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:48.283101 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-be11b60b-0f37-4618-ab26-c3cd2ce5352b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:48.283871 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-be11b60b-0f37-4618-ab26-c3cd2ce5352b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:48.291057 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-be11b60b-0f37-4618-ab26-c3cd2ce5352b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:48.291857 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-be11b60b-0f37-4618-ab26-c3cd2ce5352b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:48.292886 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-be11b60b-0f37-4618-ab26-c3cd2ce5352b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:48.293320 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-be11b60b-0f37-4618-ab26-c3cd2ce5352b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:48.407801 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-770cd544-ba64-4651-b939-95fe571f61f8 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:48.416347 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-770cd544-ba64-4651-b939-95fe571f61f8 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1758 microversion: 2.1 time: 0.264700 Jul 05 16:13:48.417029 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 344/688] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:48 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1758 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:48.463832 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-be11b60b-0f37-4618-ab26-c3cd2ce5352b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:48.471228 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-be11b60b-0f37-4618-ab26-c3cd2ce5352b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66" status: 200 len: 1362 microversion: 2.1 time: 0.191940 Jul 05 16:13:48.471789 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 345/689] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:48 2022] GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:13:48.875174 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-7d5d932d-7472-41a7-a6bb-64e87e983cfb req-fa902c3f-40b6-449b-a26c-62ec27c0f10f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66", "tag": "af3d3482-5215-478e-a23e-301b57f33edd"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:13:48.885868 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-7d5d932d-7472-41a7-a6bb-64e87e983cfb req-fa902c3f-40b6-449b-a26c-62ec27c0f10f service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:48.886311 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-7d5d932d-7472-41a7-a6bb-64e87e983cfb req-fa902c3f-40b6-449b-a26c-62ec27c0f10f service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:48.899660 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-7d5d932d-7472-41a7-a6bb-64e87e983cfb req-fa902c3f-40b6-449b-a26c-62ec27c0f10f service nova] Creating event network-changed:af3d3482-5215-478e-a23e-301b57f33edd for instance c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 on hv-cinder-84875 Jul 05 16:13:48.904631 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-7d5d932d-7472-41a7-a6bb-64e87e983cfb req-fa902c3f-40b6-449b-a26c-62ec27c0f10f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033644 Jul 05 16:13:48.905532 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 345/690] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:13:49.434265 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-eeeffd36-e96d-4a41-905e-b743953c72d8 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:49.434876 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-eeeffd36-e96d-4a41-905e-b743953c72d8 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:49.441339 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-eeeffd36-e96d-4a41-905e-b743953c72d8 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:49.441784 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-eeeffd36-e96d-4a41-905e-b743953c72d8 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:49.442539 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-eeeffd36-e96d-4a41-905e-b743953c72d8 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:49.443648 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-eeeffd36-e96d-4a41-905e-b743953c72d8 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:49.488622 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-2be1a1ff-8c30-4151-b1b2-fbf09d7da436 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:49.489348 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-2be1a1ff-8c30-4151-b1b2-fbf09d7da436 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:49.496418 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2be1a1ff-8c30-4151-b1b2-fbf09d7da436 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:49.496902 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2be1a1ff-8c30-4151-b1b2-fbf09d7da436 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:49.497664 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2be1a1ff-8c30-4151-b1b2-fbf09d7da436 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:49.498096 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2be1a1ff-8c30-4151-b1b2-fbf09d7da436 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:49.763790 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-eeeffd36-e96d-4a41-905e-b743953c72d8 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:49.768487 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-2be1a1ff-8c30-4151-b1b2-fbf09d7da436 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:49.772418 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-eeeffd36-e96d-4a41-905e-b743953c72d8 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1758 microversion: 2.1 time: 0.342038 Jul 05 16:13:49.773225 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 346/691] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:49 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1758 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:49.775874 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-2be1a1ff-8c30-4151-b1b2-fbf09d7da436 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66" status: 200 len: 1362 microversion: 2.1 time: 0.291569 Jul 05 16:13:49.776440 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 346/692] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:49 2022] GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 => generated 1362 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:13:50.789409 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-a2d212bd-bf58-4908-9d22-a3df06233521 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:50.790661 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-a2d212bd-bf58-4908-9d22-a3df06233521 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:50.792327 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-cf324330-f5ad-44bc-99ba-679db2403476 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:50.793471 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-cf324330-f5ad-44bc-99ba-679db2403476 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:50.797185 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a2d212bd-bf58-4908-9d22-a3df06233521 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:50.797633 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a2d212bd-bf58-4908-9d22-a3df06233521 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:50.800510 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a2d212bd-bf58-4908-9d22-a3df06233521 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:50.800510 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a2d212bd-bf58-4908-9d22-a3df06233521 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:50.800724 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-cf324330-f5ad-44bc-99ba-679db2403476 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:50.800724 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-cf324330-f5ad-44bc-99ba-679db2403476 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:50.801328 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-cf324330-f5ad-44bc-99ba-679db2403476 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:50.801768 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-cf324330-f5ad-44bc-99ba-679db2403476 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:51.004389 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-cf324330-f5ad-44bc-99ba-679db2403476 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:51.009818 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-a2d212bd-bf58-4908-9d22-a3df06233521 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:51.012620 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-cf324330-f5ad-44bc-99ba-679db2403476 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66" status: 200 len: 1362 microversion: 2.1 time: 0.224075 Jul 05 16:13:51.013236 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 347/693] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:50 2022] GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:13:51.017830 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-a2d212bd-bf58-4908-9d22-a3df06233521 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1758 microversion: 2.1 time: 0.232234 Jul 05 16:13:51.018574 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 347/694] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:50 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1758 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:51.858549 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-2475f02d-90ae-45d1-b48a-61fae919deef tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:51.859063 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-2475f02d-90ae-45d1-b48a-61fae919deef tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 1f42f67a-5eab-461d-9467-84aea8666852] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:51.865720 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2475f02d-90ae-45d1-b48a-61fae919deef tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:51.866252 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2475f02d-90ae-45d1-b48a-61fae919deef tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:51.867001 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2475f02d-90ae-45d1-b48a-61fae919deef tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:51.867435 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2475f02d-90ae-45d1-b48a-61fae919deef tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:51.889964 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-2475f02d-90ae-45d1-b48a-61fae919deef tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852/ips" status: 200 len: 150 microversion: 2.1 time: 0.035330 Jul 05 16:13:51.890908 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 348/695] 10.222.0.45 () {58 vars in 1247 bytes} [Tue Jul 5 16:13:51 2022] GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:13:52.030662 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-8d698465-f33e-4850-9823-acb23163972b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:52.031253 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-8d698465-f33e-4850-9823-acb23163972b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:52.035429 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-56368b95-e950-45d9-991b-709a29de5034 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:52.036044 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-56368b95-e950-45d9-991b-709a29de5034 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:52.042425 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-56368b95-e950-45d9-991b-709a29de5034 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:52.042869 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-56368b95-e950-45d9-991b-709a29de5034 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:52.043693 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-56368b95-e950-45d9-991b-709a29de5034 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:52.044144 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-56368b95-e950-45d9-991b-709a29de5034 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:52.045401 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8d698465-f33e-4850-9823-acb23163972b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:52.045857 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8d698465-f33e-4850-9823-acb23163972b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:52.046844 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8d698465-f33e-4850-9823-acb23163972b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:52.048094 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8d698465-f33e-4850-9823-acb23163972b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:52.256512 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-8d698465-f33e-4850-9823-acb23163972b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:52.261329 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-56368b95-e950-45d9-991b-709a29de5034 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:52.263959 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-8d698465-f33e-4850-9823-acb23163972b tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66" status: 200 len: 1362 microversion: 2.1 time: 0.238433 Jul 05 16:13:52.264528 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 348/696] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:52 2022] GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:52.269593 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-56368b95-e950-45d9-991b-709a29de5034 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1758 microversion: 2.1 time: 0.238445 Jul 05 16:13:52.274637 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 349/697] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:52 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1758 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:13:53.280543 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-8e5e9093-062b-4e5a-a821-c4bb57ec612d tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:53.281205 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-8e5e9093-062b-4e5a-a821-c4bb57ec612d tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:53.288553 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-ae6e7660-0a12-42dd-be3f-b42b01bd53dc tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:53.289054 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8e5e9093-062b-4e5a-a821-c4bb57ec612d tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:53.289309 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-ae6e7660-0a12-42dd-be3f-b42b01bd53dc tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:53.289432 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8e5e9093-062b-4e5a-a821-c4bb57ec612d tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:53.290058 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8e5e9093-062b-4e5a-a821-c4bb57ec612d tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:53.290492 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8e5e9093-062b-4e5a-a821-c4bb57ec612d tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:53.295664 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ae6e7660-0a12-42dd-be3f-b42b01bd53dc tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:53.296126 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ae6e7660-0a12-42dd-be3f-b42b01bd53dc tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:53.296938 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ae6e7660-0a12-42dd-be3f-b42b01bd53dc tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:53.297377 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ae6e7660-0a12-42dd-be3f-b42b01bd53dc tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:53.501836 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-8e5e9093-062b-4e5a-a821-c4bb57ec612d tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:53.508349 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-ae6e7660-0a12-42dd-be3f-b42b01bd53dc tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:53.509812 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-8e5e9093-062b-4e5a-a821-c4bb57ec612d tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66" status: 200 len: 1362 microversion: 2.1 time: 0.233108 Jul 05 16:13:53.510480 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 349/698] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:53 2022] GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:53.515308 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-3f7d2566-5b46-42bb-9ea8-827ff78f7158 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "782494d2-bf60-4491-a6cf-4403dc9a6039"}} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:13:53.516411 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-3f7d2566-5b46-42bb-9ea8-827ff78f7158 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 1f42f67a-5eab-461d-9467-84aea8666852] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:53.516783 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-ae6e7660-0a12-42dd-be3f-b42b01bd53dc tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1758 microversion: 2.1 time: 0.233254 Jul 05 16:13:53.517804 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 350/699] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:53 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1758 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:13:53.522936 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3f7d2566-5b46-42bb-9ea8-827ff78f7158 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:53.523381 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3f7d2566-5b46-42bb-9ea8-827ff78f7158 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:53.524143 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3f7d2566-5b46-42bb-9ea8-827ff78f7158 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:53.524573 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3f7d2566-5b46-42bb-9ea8-827ff78f7158 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:53.996940 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-98582100-e2e2-4548-9819-a1615a24c5df req-c1d45ec6-5bbf-4661-8ffd-279beb0edca3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66", "name": "network-vif-plugged", "status": "completed", "tag": "af3d3482-5215-478e-a23e-301b57f33edd"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:13:54.005696 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-98582100-e2e2-4548-9819-a1615a24c5df req-c1d45ec6-5bbf-4661-8ffd-279beb0edca3 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:54.006140 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-98582100-e2e2-4548-9819-a1615a24c5df req-c1d45ec6-5bbf-4661-8ffd-279beb0edca3 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:54.017070 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-98582100-e2e2-4548-9819-a1615a24c5df req-c1d45ec6-5bbf-4661-8ffd-279beb0edca3 service nova] Creating event network-vif-plugged:af3d3482-5215-478e-a23e-301b57f33edd for instance c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 on hv-cinder-84875 Jul 05 16:13:54.021896 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-98582100-e2e2-4548-9819-a1615a24c5df req-c1d45ec6-5bbf-4661-8ffd-279beb0edca3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028647 Jul 05 16:13:54.022638 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 351/700] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:13:54.230755 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-3f7d2566-5b46-42bb-9ea8-827ff78f7158 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "POST /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.719078 Jul 05 16:13:54.231392 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 350/701] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Jul 5 16:13:53 2022] POST /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852/os-volume_attachments => generated 194 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:13:54.527034 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-03ee6e25-7bcc-406a-a65b-75d9aa62ee11 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:54.527741 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-03ee6e25-7bcc-406a-a65b-75d9aa62ee11 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:54.533958 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-03ee6e25-7bcc-406a-a65b-75d9aa62ee11 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:54.534410 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-03ee6e25-7bcc-406a-a65b-75d9aa62ee11 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:54.535175 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-03ee6e25-7bcc-406a-a65b-75d9aa62ee11 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:54.535377 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-f2ba899a-2b15-44d5-a396-2cf2616010e7 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:54.535804 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-03ee6e25-7bcc-406a-a65b-75d9aa62ee11 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:54.536084 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-f2ba899a-2b15-44d5-a396-2cf2616010e7 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:54.542831 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f2ba899a-2b15-44d5-a396-2cf2616010e7 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:54.543335 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f2ba899a-2b15-44d5-a396-2cf2616010e7 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:54.544094 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f2ba899a-2b15-44d5-a396-2cf2616010e7 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:54.544528 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f2ba899a-2b15-44d5-a396-2cf2616010e7 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:54.740240 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-03ee6e25-7bcc-406a-a65b-75d9aa62ee11 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:54.747683 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-03ee6e25-7bcc-406a-a65b-75d9aa62ee11 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66" status: 200 len: 1362 microversion: 2.1 time: 0.225215 Jul 05 16:13:54.748260 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 352/702] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:54 2022] GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:54.749088 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-f2ba899a-2b15-44d5-a396-2cf2616010e7 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:54.757097 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-f2ba899a-2b15-44d5-a396-2cf2616010e7 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1758 microversion: 2.1 time: 0.226439 Jul 05 16:13:54.757649 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 351/703] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:54 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1758 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:13:55.764642 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-6be95b1e-d82a-4c8f-8d1b-7a02c9c2670e tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:55.765387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-6be95b1e-d82a-4c8f-8d1b-7a02c9c2670e tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:55.767316 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell0:SELECT=2 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:55.768107 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell0:SELECT=6 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:55.773051 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-8ca0fea7-1517-4bc3-ba94-44ce804dd707 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:55.773514 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6be95b1e-d82a-4c8f-8d1b-7a02c9c2670e tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:55.773670 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-8ca0fea7-1517-4bc3-ba94-44ce804dd707 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:55.773902 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6be95b1e-d82a-4c8f-8d1b-7a02c9c2670e tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:55.774690 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6be95b1e-d82a-4c8f-8d1b-7a02c9c2670e tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:55.775109 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6be95b1e-d82a-4c8f-8d1b-7a02c9c2670e tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:55.776113 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell0:SELECT=6 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:55.780914 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8ca0fea7-1517-4bc3-ba94-44ce804dd707 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:55.786436 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8ca0fea7-1517-4bc3-ba94-44ce804dd707 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:55.786436 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8ca0fea7-1517-4bc3-ba94-44ce804dd707 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:55.786436 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8ca0fea7-1517-4bc3-ba94-44ce804dd707 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:55.970060 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-6be95b1e-d82a-4c8f-8d1b-7a02c9c2670e tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e2fc1ec676438392d7925b43b806f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec37a457530439b8728dd2ad2b6b7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:55.978086 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-6be95b1e-d82a-4c8f-8d1b-7a02c9c2670e tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66" status: 200 len: 1548 microversion: 2.1 time: 0.217399 Jul 05 16:13:55.978872 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 353/704] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:55 2022] GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 => generated 1548 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:55.987833 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-8ca0fea7-1517-4bc3-ba94-44ce804dd707 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:55.995489 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-9ac8fc63-9216-49cb-9416-fa893cbb5b98 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:55.995980 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-9ac8fc63-9216-49cb-9416-fa893cbb5b98 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:55.998788 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-8ca0fea7-1517-4bc3-ba94-44ce804dd707 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1758 microversion: 2.1 time: 0.229434 Jul 05 16:13:55.999431 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 352/705] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:55 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1758 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:13:56.002096 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9ac8fc63-9216-49cb-9416-fa893cbb5b98 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:56.002543 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9ac8fc63-9216-49cb-9416-fa893cbb5b98 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:56.003307 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9ac8fc63-9216-49cb-9416-fa893cbb5b98 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:56.003739 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9ac8fc63-9216-49cb-9416-fa893cbb5b98 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:56.019055 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:56.085602 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-9ac8fc63-9216-49cb-9416-fa893cbb5b98 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093843 Jul 05 16:13:56.090022 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 354/706] 10.222.0.45 () {58 vars in 1274 bytes} [Tue Jul 5 16:13:55 2022] GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:13:57.017027 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-974e2cfb-6522-4120-80f8-ce8272d210ef tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:57.017645 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-974e2cfb-6522-4120-80f8-ce8272d210ef tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:57.024190 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-974e2cfb-6522-4120-80f8-ce8272d210ef tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:57.024573 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-974e2cfb-6522-4120-80f8-ce8272d210ef tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:57.025386 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-974e2cfb-6522-4120-80f8-ce8272d210ef tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:57.025823 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-974e2cfb-6522-4120-80f8-ce8272d210ef tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:57.029810 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:13:57.255503 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-974e2cfb-6522-4120-80f8-ce8272d210ef tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:57.263723 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-974e2cfb-6522-4120-80f8-ce8272d210ef tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1758 microversion: 2.1 time: 0.250605 Jul 05 16:13:57.264297 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 353/707] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:57 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1758 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:57.367478 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-29495b4b-574e-445c-a687-705dd260dbda req-df910568-b8b0-4628-a532-d1adfc4f2b27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66", "tag": "af3d3482-5215-478e-a23e-301b57f33edd"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:13:57.376683 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-29495b4b-574e-445c-a687-705dd260dbda req-df910568-b8b0-4628-a532-d1adfc4f2b27 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:57.380669 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-29495b4b-574e-445c-a687-705dd260dbda req-df910568-b8b0-4628-a532-d1adfc4f2b27 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:57.388726 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-29495b4b-574e-445c-a687-705dd260dbda req-df910568-b8b0-4628-a532-d1adfc4f2b27 service nova] Creating event network-changed:af3d3482-5215-478e-a23e-301b57f33edd for instance c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 on hv-cinder-84875 Jul 05 16:13:57.393825 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-29495b4b-574e-445c-a687-705dd260dbda req-df910568-b8b0-4628-a532-d1adfc4f2b27 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031129 Jul 05 16:13:57.394634 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 355/708] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:13:58.281536 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-5c2a8744-405a-4b78-ac91-b63b780d8635 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:58.282297 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-5c2a8744-405a-4b78-ac91-b63b780d8635 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:58.289108 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-5c2a8744-405a-4b78-ac91-b63b780d8635 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:58.290630 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-5c2a8744-405a-4b78-ac91-b63b780d8635 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:58.290630 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-5c2a8744-405a-4b78-ac91-b63b780d8635 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:58.291102 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-5c2a8744-405a-4b78-ac91-b63b780d8635 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:58.439373 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-5c2a8744-405a-4b78-ac91-b63b780d8635 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:58.448134 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-5c2a8744-405a-4b78-ac91-b63b780d8635 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1758 microversion: 2.1 time: 0.170650 Jul 05 16:13:58.448702 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 354/709] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:58 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:13:59.467064 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-8383009f-3ff2-4c0a-a5c7-51770d013a20 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:13:59.467679 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-8383009f-3ff2-4c0a-a5c7-51770d013a20 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:13:59.474899 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8383009f-3ff2-4c0a-a5c7-51770d013a20 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:59.475341 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8383009f-3ff2-4c0a-a5c7-51770d013a20 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:59.476091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8383009f-3ff2-4c0a-a5c7-51770d013a20 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:13:59.476525 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8383009f-3ff2-4c0a-a5c7-51770d013a20 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:13:59.620727 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-8383009f-3ff2-4c0a-a5c7-51770d013a20 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:13:59.628667 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-8383009f-3ff2-4c0a-a5c7-51770d013a20 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1758 microversion: 2.1 time: 0.166254 Jul 05 16:13:59.630159 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 356/710] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:13:59 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:00.646307 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-b7dd4ffd-dc33-41b3-a154-55000ac483f0 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:00.646929 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-b7dd4ffd-dc33-41b3-a154-55000ac483f0 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:00.653322 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b7dd4ffd-dc33-41b3-a154-55000ac483f0 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:00.653767 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b7dd4ffd-dc33-41b3-a154-55000ac483f0 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:00.654527 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b7dd4ffd-dc33-41b3-a154-55000ac483f0 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:00.654964 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b7dd4ffd-dc33-41b3-a154-55000ac483f0 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:00.799651 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-b7dd4ffd-dc33-41b3-a154-55000ac483f0 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:00.808057 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-b7dd4ffd-dc33-41b3-a154-55000ac483f0 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1761 microversion: 2.1 time: 0.165613 Jul 05 16:14:00.808632 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 355/711] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:00 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1761 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:02.122988 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-8fb8bb95-3326-42dd-b749-bd1c638285cb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:02.123513 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-8fb8bb95-3326-42dd-b749-bd1c638285cb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:02.130035 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8fb8bb95-3326-42dd-b749-bd1c638285cb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:02.130478 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8fb8bb95-3326-42dd-b749-bd1c638285cb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:02.131298 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8fb8bb95-3326-42dd-b749-bd1c638285cb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:02.131733 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8fb8bb95-3326-42dd-b749-bd1c638285cb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:02.209782 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.objects.instance [None req-8fb8bb95-3326-42dd-b749-bd1c638285cb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lazy-loading 'services' on Instance uuid 42be8657-fc50-4057-b373-e7bcf984e261 {{(pid=118320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 16:14:02.428551 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-8fb8bb95-3326-42dd-b749-bd1c638285cb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "DELETE /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261/os-volume_attachments/b93ba52f-6676-4661-8815-bfc20f0eb022" status: 202 len: 0 microversion: 2.1 time: 0.308862 Jul 05 16:14:02.429228 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 357/712] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Jul 5 16:14:02 2022] DELETE /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261/os-volume_attachments/b93ba52f-6676-4661-8815-bfc20f0eb022 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 16:14:02.437559 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-f6e77c7b-eeb7-4388-99c9-892f3cee8ea5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:02.438542 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-f6e77c7b-eeb7-4388-99c9-892f3cee8ea5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:02.444993 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f6e77c7b-eeb7-4388-99c9-892f3cee8ea5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:02.445436 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f6e77c7b-eeb7-4388-99c9-892f3cee8ea5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:02.446197 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f6e77c7b-eeb7-4388-99c9-892f3cee8ea5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:02.446628 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f6e77c7b-eeb7-4388-99c9-892f3cee8ea5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:02.475319 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-f6e77c7b-eeb7-4388-99c9-892f3cee8ea5 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041221 Jul 05 16:14:02.475866 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 356/713] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Jul 5 16:14:02 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:14:02.824743 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-fe9fa396-85eb-4711-9a22-b6ce20cfc594 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "782494d2-bf60-4491-a6cf-4403dc9a6039"}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:14:02.825989 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-fe9fa396-85eb-4711-9a22-b6ce20cfc594 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 1f42f67a-5eab-461d-9467-84aea8666852] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:02.832006 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fe9fa396-85eb-4711-9a22-b6ce20cfc594 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:02.832447 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fe9fa396-85eb-4711-9a22-b6ce20cfc594 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:02.833222 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fe9fa396-85eb-4711-9a22-b6ce20cfc594 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:02.833648 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fe9fa396-85eb-4711-9a22-b6ce20cfc594 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:02.913555 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-fe9fa396-85eb-4711-9a22-b6ce20cfc594 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] HTTP exception thrown: Invalid volume: volume 782494d2-bf60-4491-a6cf-4403dc9a6039 is already attached to instances: 1f42f67a-5eab-461d-9467-84aea8666852 Jul 05 16:14:02.915270 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-fe9fa396-85eb-4711-9a22-b6ce20cfc594 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Request method failure captured: Jul 05 16:14:02.915270 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: POST /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852/os-volume_attachments HTTP/1.1 Jul 05 16:14:02.915270 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:14:02.915270 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:14:02.915270 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:14:02.915270 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 74 Jul 05 16:14:02.915270 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:14:02.915270 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:14:02.915270 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:14:02.915270 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:14:02.915270 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIcG6oJHBbOiV-hRrdMXuy13iZZ6hvCfk-vTWz4vq2ula5Qwq5GKAKhC7pohxgL-mMXAkQ0I8c07z_L-klhBhC6mFKTl8PgxIghG2kxSHmXvGruMCHGJe1XXCXlDVgGJeXVlaQZZep4KSMSbhku1jx5l6fL00FOe6C27ag91K3fk98 Jul 05 16:14:02.915270 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:14:02.915270 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:14:02.915270 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:14:02.915270 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:14:02.915270 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:14:02.915270 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:14:02.915270 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 42e6ad67dbf542528726c545872ac10c Jul 05 16:14:02.915270 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:14:02.915270 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:14:02.915270 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:14:02.916626 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_42e6ad67dbf542528726c545872ac10c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:14:02.916626 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:14:02.916626 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 42e6ad67dbf542528726c545872ac10c Jul 05 16:14:02.916626 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:14:02.916626 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-AttachVolumeNegativeTest-547019280-project Jul 05 16:14:02.916626 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:14:02.916626 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:14:02.916626 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: 0c8512e7c1704fac9cc4fcfe3bf1f18b Jul 05 16:14:02.916626 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-AttachVolumeNegativeTest-547019280-project Jul 05 16:14:02.916626 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Jul 05 16:14:02.916626 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {"volumeAttachment": {"volumeId": "782494d2-bf60-4491-a6cf-4403dc9a6039"}} Jul 05 16:14:02.916626 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:14:02.917482 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Invalid volume: volume 782494d2-bf60-4491-a6cf-4403dc9a6039 is already attached to instances: 1f42f67a-5eab-461d-9467-84aea8666852 Jul 05 16:14:02.917482 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'server_id': '1f42f67a-5eab-461d-9467-84aea8666852', 'body': {'volumeAttachment': {'volumeId': '782494d2-bf60-4491-a6cf-4403dc9a6039'}}} Jul 05 16:14:02.917482 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:14:02.917482 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:14:02.917482 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 05 16:14:02.917482 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 05 16:14:02.917482 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 05 16:14:02.917482 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 05 16:14:02.917482 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 05 16:14:02.917482 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 05 16:14:02.917482 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 05 16:14:02.917482 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 05 16:14:02.917482 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 05 16:14:02.917482 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 05 16:14:02.917482 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 782494d2-bf60-4491-a6cf-4403dc9a6039 is already attached to instances: 1f42f67a-5eab-461d-9467-84aea8666852 Jul 05 16:14:02.917482 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:02.917482 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:14:02.917482 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:02.917482 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:14:02.919166 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:14:02.919166 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:14:02.919166 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:14:02.919166 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:14:02.919166 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:14:02.919166 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:14:02.919166 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 16:14:02.919166 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 16:14:02.919166 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 16:14:02.919166 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 16:14:02.919166 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 16:14:02.919166 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 16:14:02.919166 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 05 16:14:02.919166 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 05 16:14:02.919166 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 782494d2-bf60-4491-a6cf-4403dc9a6039 is already attached to instances: 1f42f67a-5eab-461d-9467-84aea8666852 Jul 05 16:14:02.919166 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:02.919166 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:14:02.919166 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:02.919166 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:14:02.919166 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:14:02.921517 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:14:02.921517 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:14:02.921517 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:14:02.921517 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 782494d2-bf60-4491-a6cf-4403dc9a6039 is already attached to instances: 1f42f67a-5eab-461d-9467-84aea8666852 Jul 05 16:14:02.921517 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:02.921517 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-fe9fa396-85eb-4711-9a22-b6ce20cfc594 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Returning 400 to user: Invalid volume: volume 782494d2-bf60-4491-a6cf-4403dc9a6039 is already attached to instances: 1f42f67a-5eab-461d-9467-84aea8666852 {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:14:02.921517 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-fe9fa396-85eb-4711-9a22-b6ce20cfc594 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "POST /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096227 Jul 05 16:14:02.921517 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 358/714] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Jul 5 16:14:02 2022] POST /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 05 16:14:02.977593 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-40960c9a-0bb9-4554-be57-228d2c613cb9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:02.978341 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-40960c9a-0bb9-4554-be57-228d2c613cb9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 1f42f67a-5eab-461d-9467-84aea8666852] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:02.984964 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-40960c9a-0bb9-4554-be57-228d2c613cb9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:02.985530 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-40960c9a-0bb9-4554-be57-228d2c613cb9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:02.986398 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-40960c9a-0bb9-4554-be57-228d2c613cb9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:02.986919 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-40960c9a-0bb9-4554-be57-228d2c613cb9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:03.066885 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.objects.instance [None req-40960c9a-0bb9-4554-be57-228d2c613cb9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lazy-loading 'services' on Instance uuid 1f42f67a-5eab-461d-9467-84aea8666852 {{(pid=118319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 16:14:03.264333 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-40960c9a-0bb9-4554-be57-228d2c613cb9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852/os-volume_attachments/782494d2-bf60-4491-a6cf-4403dc9a6039" status: 202 len: 0 microversion: 2.1 time: 0.291294 Jul 05 16:14:03.264965 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 357/715] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Jul 5 16:14:02 2022] DELETE /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852/os-volume_attachments/782494d2-bf60-4491-a6cf-4403dc9a6039 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 16:14:03.273970 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-2aafe46c-4baa-4e16-b94f-5941ae023a56 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:03.274993 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-2aafe46c-4baa-4e16-b94f-5941ae023a56 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 1f42f67a-5eab-461d-9467-84aea8666852] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:03.283083 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2aafe46c-4baa-4e16-b94f-5941ae023a56 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:03.283541 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2aafe46c-4baa-4e16-b94f-5941ae023a56 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:03.284326 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2aafe46c-4baa-4e16-b94f-5941ae023a56 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:03.284793 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2aafe46c-4baa-4e16-b94f-5941ae023a56 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:03.315877 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-2aafe46c-4baa-4e16-b94f-5941ae023a56 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046499 Jul 05 16:14:03.316450 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 359/716] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Jul 5 16:14:03 2022] GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:14:03.488141 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-1dd0c938-2847-484b-bd4e-e347f0631898 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:03.489244 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-1dd0c938-2847-484b-bd4e-e347f0631898 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:03.495483 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1dd0c938-2847-484b-bd4e-e347f0631898 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:03.495943 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1dd0c938-2847-484b-bd4e-e347f0631898 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:03.496710 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1dd0c938-2847-484b-bd4e-e347f0631898 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:03.497176 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1dd0c938-2847-484b-bd4e-e347f0631898 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:03.526269 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-1dd0c938-2847-484b-bd4e-e347f0631898 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043676 Jul 05 16:14:03.526855 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 358/717] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Jul 5 16:14:03 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:14:04.328124 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-d1188c9a-77d1-4750-9fe4-ac9765a30c86 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:04.329148 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-d1188c9a-77d1-4750-9fe4-ac9765a30c86 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 1f42f67a-5eab-461d-9467-84aea8666852] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:04.336292 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d1188c9a-77d1-4750-9fe4-ac9765a30c86 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:04.336745 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d1188c9a-77d1-4750-9fe4-ac9765a30c86 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:04.337543 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d1188c9a-77d1-4750-9fe4-ac9765a30c86 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:04.337981 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d1188c9a-77d1-4750-9fe4-ac9765a30c86 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:04.367671 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-d1188c9a-77d1-4750-9fe4-ac9765a30c86 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043490 Jul 05 16:14:04.368242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 360/718] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Jul 5 16:14:04 2022] GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 16:14:04.425431 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-cb1b64e0-21d7-44b9-af2b-0ed2a9752322 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:04.426308 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-cb1b64e0-21d7-44b9-af2b-0ed2a9752322 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 1f42f67a-5eab-461d-9467-84aea8666852] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:04.432037 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cb1b64e0-21d7-44b9-af2b-0ed2a9752322 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:04.432492 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cb1b64e0-21d7-44b9-af2b-0ed2a9752322 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:04.433290 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cb1b64e0-21d7-44b9-af2b-0ed2a9752322 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:04.433732 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cb1b64e0-21d7-44b9-af2b-0ed2a9752322 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:04.457720 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-cb1b64e0-21d7-44b9-af2b-0ed2a9752322 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 1f42f67a-5eab-461d-9467-84aea8666852] Going to try to terminate instance {{(pid=118319) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 16:14:04.539448 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-4b7413b3-f403-4756-970a-2cc138d9a88e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:04.540286 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-4b7413b3-f403-4756-970a-2cc138d9a88e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:04.546210 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4b7413b3-f403-4756-970a-2cc138d9a88e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:04.546654 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4b7413b3-f403-4756-970a-2cc138d9a88e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:04.547405 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4b7413b3-f403-4756-970a-2cc138d9a88e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:04.547836 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4b7413b3-f403-4756-970a-2cc138d9a88e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:04.575308 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-4b7413b3-f403-4756-970a-2cc138d9a88e tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040547 Jul 05 16:14:04.575865 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 361/719] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Jul 5 16:14:04 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 05 16:14:04.656119 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-9dfc43b8-882c-4c57-a14b-a1a336785c42 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:04.656619 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-9dfc43b8-882c-4c57-a14b-a1a336785c42 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:04.662912 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9dfc43b8-882c-4c57-a14b-a1a336785c42 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:04.663362 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9dfc43b8-882c-4c57-a14b-a1a336785c42 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:04.664128 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9dfc43b8-882c-4c57-a14b-a1a336785c42 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:04.664560 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9dfc43b8-882c-4c57-a14b-a1a336785c42 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:04.688720 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-9dfc43b8-882c-4c57-a14b-a1a336785c42 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Going to try to terminate instance {{(pid=118320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 16:14:04.726394 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-cb1b64e0-21d7-44b9-af2b-0ed2a9752322 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852" status: 204 len: 0 microversion: 2.1 time: 0.304657 Jul 05 16:14:04.727027 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 359/720] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Jul 5 16:14:04 2022] DELETE /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 16:14:04.735676 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-95f66fb4-eb37-4daf-a2c4-8422c7d87e1a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:04.740453 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-95f66fb4-eb37-4daf-a2c4-8422c7d87e1a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 1f42f67a-5eab-461d-9467-84aea8666852] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:04.742399 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-95f66fb4-eb37-4daf-a2c4-8422c7d87e1a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:04.742851 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-95f66fb4-eb37-4daf-a2c4-8422c7d87e1a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:04.743615 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-95f66fb4-eb37-4daf-a2c4-8422c7d87e1a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:04.744053 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-95f66fb4-eb37-4daf-a2c4-8422c7d87e1a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:04.871683 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-95f66fb4-eb37-4daf-a2c4-8422c7d87e1a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:04.879293 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-95f66fb4-eb37-4daf-a2c4-8422c7d87e1a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852" status: 200 len: 1682 microversion: 2.1 time: 0.147798 Jul 05 16:14:04.884059 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 360/721] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:04 2022] GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:14:04.988796 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-9dfc43b8-882c-4c57-a14b-a1a336785c42 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "DELETE /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 204 len: 0 microversion: 2.1 time: 0.336314 Jul 05 16:14:04.989415 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 362/722] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Jul 5 16:14:04 2022] DELETE /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 05 16:14:04.997313 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-a2c83836-1a98-43c0-ba80-88e01e8aae56 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:04.997931 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-a2c83836-1a98-43c0-ba80-88e01e8aae56 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:05.003925 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a2c83836-1a98-43c0-ba80-88e01e8aae56 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:05.004374 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a2c83836-1a98-43c0-ba80-88e01e8aae56 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:05.005171 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a2c83836-1a98-43c0-ba80-88e01e8aae56 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:05.006118 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a2c83836-1a98-43c0-ba80-88e01e8aae56 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:05.131385 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-a2c83836-1a98-43c0-ba80-88e01e8aae56 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:05.138853 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-a2c83836-1a98-43c0-ba80-88e01e8aae56 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1688 microversion: 2.1 time: 0.145339 Jul 05 16:14:05.139424 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 361/723] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:04 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1688 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:05.897605 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-b770c147-0f46-4bc5-81d3-790f783efc33 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:05.898305 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-b770c147-0f46-4bc5-81d3-790f783efc33 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 1f42f67a-5eab-461d-9467-84aea8666852] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:05.904878 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b770c147-0f46-4bc5-81d3-790f783efc33 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:05.905323 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b770c147-0f46-4bc5-81d3-790f783efc33 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:05.906078 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b770c147-0f46-4bc5-81d3-790f783efc33 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:05.906510 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b770c147-0f46-4bc5-81d3-790f783efc33 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:06.038618 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-b770c147-0f46-4bc5-81d3-790f783efc33 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:06.045971 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-b770c147-0f46-4bc5-81d3-790f783efc33 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852" status: 200 len: 1682 microversion: 2.1 time: 0.152599 Jul 05 16:14:06.046536 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 363/724] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:05 2022] GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:06.156725 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-e9f9442a-3a05-460b-947b-199022f44052 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:06.157300 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-e9f9442a-3a05-460b-947b-199022f44052 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:06.164144 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e9f9442a-3a05-460b-947b-199022f44052 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:06.164618 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e9f9442a-3a05-460b-947b-199022f44052 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:06.165407 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e9f9442a-3a05-460b-947b-199022f44052 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:06.165837 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e9f9442a-3a05-460b-947b-199022f44052 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:06.294981 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-e9f9442a-3a05-460b-947b-199022f44052 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:06.303332 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-e9f9442a-3a05-460b-947b-199022f44052 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1688 microversion: 2.1 time: 0.149976 Jul 05 16:14:06.303916 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 362/725] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:06 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:07.063402 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-641b5e30-9ca8-4116-8c62-262ff724d818 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:07.064025 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-641b5e30-9ca8-4116-8c62-262ff724d818 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 1f42f67a-5eab-461d-9467-84aea8666852] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:07.071201 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-641b5e30-9ca8-4116-8c62-262ff724d818 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:07.071656 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-641b5e30-9ca8-4116-8c62-262ff724d818 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:07.072426 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-641b5e30-9ca8-4116-8c62-262ff724d818 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:07.072893 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-641b5e30-9ca8-4116-8c62-262ff724d818 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:07.200223 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-641b5e30-9ca8-4116-8c62-262ff724d818 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:07.207642 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-641b5e30-9ca8-4116-8c62-262ff724d818 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852" status: 200 len: 1682 microversion: 2.1 time: 0.148096 Jul 05 16:14:07.208210 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 364/726] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:07 2022] GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:07.320290 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-ee505297-94ed-47c9-bfc3-90e3f2571b3b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:07.320868 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-ee505297-94ed-47c9-bfc3-90e3f2571b3b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:07.327557 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ee505297-94ed-47c9-bfc3-90e3f2571b3b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:07.328007 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ee505297-94ed-47c9-bfc3-90e3f2571b3b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:07.328788 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ee505297-94ed-47c9-bfc3-90e3f2571b3b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:07.329453 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ee505297-94ed-47c9-bfc3-90e3f2571b3b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:07.458512 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-ee505297-94ed-47c9-bfc3-90e3f2571b3b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:07.465954 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-ee505297-94ed-47c9-bfc3-90e3f2571b3b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1688 microversion: 2.1 time: 0.150302 Jul 05 16:14:07.466521 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 363/727] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:07 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1688 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:08.226068 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-3b502c36-5bb0-4936-a006-425e45fe0572 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:08.226746 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-3b502c36-5bb0-4936-a006-425e45fe0572 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 1f42f67a-5eab-461d-9467-84aea8666852] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:08.233195 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3b502c36-5bb0-4936-a006-425e45fe0572 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:08.233644 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3b502c36-5bb0-4936-a006-425e45fe0572 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:08.234405 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3b502c36-5bb0-4936-a006-425e45fe0572 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:08.235100 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3b502c36-5bb0-4936-a006-425e45fe0572 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:08.364655 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-3b502c36-5bb0-4936-a006-425e45fe0572 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:08.372083 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-3b502c36-5bb0-4936-a006-425e45fe0572 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852" status: 200 len: 1682 microversion: 2.1 time: 0.150584 Jul 05 16:14:08.372652 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 365/728] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:08 2022] GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:08.482790 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-7d88d2fa-a242-47c0-9a14-5f198915780a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:08.483341 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-7d88d2fa-a242-47c0-9a14-5f198915780a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:08.490113 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7d88d2fa-a242-47c0-9a14-5f198915780a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:08.490565 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7d88d2fa-a242-47c0-9a14-5f198915780a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:08.491329 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7d88d2fa-a242-47c0-9a14-5f198915780a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:08.491770 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7d88d2fa-a242-47c0-9a14-5f198915780a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:08.627636 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-7d88d2fa-a242-47c0-9a14-5f198915780a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:08.635826 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-7d88d2fa-a242-47c0-9a14-5f198915780a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1688 microversion: 2.1 time: 0.156872 Jul 05 16:14:08.636423 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 364/729] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:08 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:09.389297 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-f20e042c-5139-4a2a-b058-f6303bb128ce tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:09.389910 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-f20e042c-5139-4a2a-b058-f6303bb128ce tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 1f42f67a-5eab-461d-9467-84aea8666852] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:09.396277 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f20e042c-5139-4a2a-b058-f6303bb128ce tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:09.396720 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f20e042c-5139-4a2a-b058-f6303bb128ce tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:09.397504 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f20e042c-5139-4a2a-b058-f6303bb128ce tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:09.397937 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f20e042c-5139-4a2a-b058-f6303bb128ce tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:09.523133 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-f20e042c-5139-4a2a-b058-f6303bb128ce tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:09.530615 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-f20e042c-5139-4a2a-b058-f6303bb128ce tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852" status: 200 len: 1682 microversion: 2.1 time: 0.145115 Jul 05 16:14:09.531197 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 366/730] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:09 2022] GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852 => generated 1682 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:09.656086 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-1b38dad0-312a-428b-95e5-8dd73f553353 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:09.656615 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-1b38dad0-312a-428b-95e5-8dd73f553353 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:09.663928 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1b38dad0-312a-428b-95e5-8dd73f553353 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:09.664400 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1b38dad0-312a-428b-95e5-8dd73f553353 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:09.665201 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1b38dad0-312a-428b-95e5-8dd73f553353 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:09.665636 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1b38dad0-312a-428b-95e5-8dd73f553353 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:09.828887 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-1b38dad0-312a-428b-95e5-8dd73f553353 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:09.837135 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-1b38dad0-312a-428b-95e5-8dd73f553353 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1688 microversion: 2.1 time: 0.184902 Jul 05 16:14:09.843041 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 365/731] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:09 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1688 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:09.939895 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-363af9d4-b847-4df5-9063-bfbc90feade0 req-7e435886-f28f-466f-91e9-100de2e9d74e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f42f67a-5eab-461d-9467-84aea8666852", "name": "network-vif-unplugged", "status": "completed", "tag": "56eeb76f-52f3-4f96-bf88-99c80eacdaa7"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:14:09.944490 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:09.949740 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-363af9d4-b847-4df5-9063-bfbc90feade0 req-7e435886-f28f-466f-91e9-100de2e9d74e service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:09.950176 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-363af9d4-b847-4df5-9063-bfbc90feade0 req-7e435886-f28f-466f-91e9-100de2e9d74e service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:09.961745 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-363af9d4-b847-4df5-9063-bfbc90feade0 req-7e435886-f28f-466f-91e9-100de2e9d74e service nova] Creating event network-vif-unplugged:56eeb76f-52f3-4f96-bf88-99c80eacdaa7 for instance 1f42f67a-5eab-461d-9467-84aea8666852 on hv-cinder-84875 Jul 05 16:14:09.967251 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-363af9d4-b847-4df5-9063-bfbc90feade0 req-7e435886-f28f-466f-91e9-100de2e9d74e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030912 Jul 05 16:14:09.967862 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 367/732] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:14:10.548410 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-9f62aacd-4085-424b-a03b-8b894b3ff860 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:10.549068 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-9f62aacd-4085-424b-a03b-8b894b3ff860 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 1f42f67a-5eab-461d-9467-84aea8666852] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:10.555497 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9f62aacd-4085-424b-a03b-8b894b3ff860 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:10.555937 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9f62aacd-4085-424b-a03b-8b894b3ff860 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:10.556688 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9f62aacd-4085-424b-a03b-8b894b3ff860 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:10.557172 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9f62aacd-4085-424b-a03b-8b894b3ff860 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:10.806473 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-9f62aacd-4085-424b-a03b-8b894b3ff860 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:10.813922 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-9f62aacd-4085-424b-a03b-8b894b3ff860 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852" status: 200 len: 1682 microversion: 2.1 time: 0.269495 Jul 05 16:14:10.814488 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 366/733] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:10 2022] GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852 => generated 1682 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:10.856360 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-2b741616-074f-46d1-a78e-d15bd0d28f2f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:10.857090 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-2b741616-074f-46d1-a78e-d15bd0d28f2f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:10.865595 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2b741616-074f-46d1-a78e-d15bd0d28f2f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:10.866048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2b741616-074f-46d1-a78e-d15bd0d28f2f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:10.866882 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2b741616-074f-46d1-a78e-d15bd0d28f2f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:10.867330 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2b741616-074f-46d1-a78e-d15bd0d28f2f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:11.322329 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-2b741616-074f-46d1-a78e-d15bd0d28f2f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:11.332034 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-2b741616-074f-46d1-a78e-d15bd0d28f2f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1688 microversion: 2.1 time: 0.479836 Jul 05 16:14:11.332996 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 368/734] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:10 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1688 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:11.516888 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [req-e6476dc5-5b93-40b3-a9d2-fb5184d7c731 req-7bb060a8-e4f3-44cf-8099-4951b8ce9d45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f42f67a-5eab-461d-9467-84aea8666852", "name": "network-vif-deleted", "tag": "56eeb76f-52f3-4f96-bf88-99c80eacdaa7"}]} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:14:11.544693 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-e6476dc5-5b93-40b3-a9d2-fb5184d7c731 req-7bb060a8-e4f3-44cf-8099-4951b8ce9d45 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:11.544693 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-e6476dc5-5b93-40b3-a9d2-fb5184d7c731 req-7bb060a8-e4f3-44cf-8099-4951b8ce9d45 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:11.544693 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.compute.server_external_events [req-e6476dc5-5b93-40b3-a9d2-fb5184d7c731 req-7bb060a8-e4f3-44cf-8099-4951b8ce9d45 service nova] Creating event network-vif-deleted:56eeb76f-52f3-4f96-bf88-99c80eacdaa7 for instance 1f42f67a-5eab-461d-9467-84aea8666852 on hv-cinder-84875 Jul 05 16:14:11.547201 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [req-e6476dc5-5b93-40b3-a9d2-fb5184d7c731 req-7bb060a8-e4f3-44cf-8099-4951b8ce9d45 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037115 Jul 05 16:14:11.548422 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 367/735] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:14:11.831538 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-c4954faa-e19a-4825-b94e-a54fdbe89cc3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:11.832469 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-c4954faa-e19a-4825-b94e-a54fdbe89cc3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 1f42f67a-5eab-461d-9467-84aea8666852] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:11.840041 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c4954faa-e19a-4825-b94e-a54fdbe89cc3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:11.840936 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c4954faa-e19a-4825-b94e-a54fdbe89cc3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:11.842011 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c4954faa-e19a-4825-b94e-a54fdbe89cc3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:11.843138 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c4954faa-e19a-4825-b94e-a54fdbe89cc3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:11.932907 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c4954faa-e19a-4825-b94e-a54fdbe89cc3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:11.949443 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-c4954faa-e19a-4825-b94e-a54fdbe89cc3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852" status: 200 len: 1326 microversion: 2.1 time: 0.121933 Jul 05 16:14:11.951101 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 369/736] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:11 2022] GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852 => generated 1326 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:12.351804 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-17fde5c4-773a-4304-a39d-4e3d118b755b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:12.353435 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-17fde5c4-773a-4304-a39d-4e3d118b755b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:12.360170 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-17fde5c4-773a-4304-a39d-4e3d118b755b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:12.360751 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-17fde5c4-773a-4304-a39d-4e3d118b755b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:12.361665 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-17fde5c4-773a-4304-a39d-4e3d118b755b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:12.362163 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-17fde5c4-773a-4304-a39d-4e3d118b755b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:12.369030 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:12.396232 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-17fde5c4-773a-4304-a39d-4e3d118b755b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:12.396758 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-17fde5c4-773a-4304-a39d-4e3d118b755b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:12.397695 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.objects.instance [None req-17fde5c4-773a-4304-a39d-4e3d118b755b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lazy-loading 'fault' on Instance uuid 42be8657-fc50-4057-b373-e7bcf984e261 {{(pid=118319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 16:14:12.445974 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-17fde5c4-773a-4304-a39d-4e3d118b755b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:12.454190 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-17fde5c4-773a-4304-a39d-4e3d118b755b tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 200 len: 1335 microversion: 2.1 time: 0.107539 Jul 05 16:14:12.454794 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 368/737] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:12 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 1335 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:12.968026 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-4ba5ce3e-56a5-40e7-ae74-66f9e0293e56 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:12.968668 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-4ba5ce3e-56a5-40e7-ae74-66f9e0293e56 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 1f42f67a-5eab-461d-9467-84aea8666852] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:12.975474 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4ba5ce3e-56a5-40e7-ae74-66f9e0293e56 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:12.975986 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4ba5ce3e-56a5-40e7-ae74-66f9e0293e56 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:12.976683 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4ba5ce3e-56a5-40e7-ae74-66f9e0293e56 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:12.977713 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4ba5ce3e-56a5-40e7-ae74-66f9e0293e56 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:13.145214 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-4ba5ce3e-56a5-40e7-ae74-66f9e0293e56 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] HTTP exception thrown: Instance 1f42f67a-5eab-461d-9467-84aea8666852 could not be found. Jul 05 16:14:13.147452 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-4ba5ce3e-56a5-40e7-ae74-66f9e0293e56 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Request method failure captured: Jul 05 16:14:13.147452 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852 HTTP/1.1 Jul 05 16:14:13.147452 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:14:13.147452 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:14:13.147452 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:14:13.147452 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:14:13.147452 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:14:13.147452 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:14:13.147452 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:14:13.147452 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:14:13.147452 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIcG6oJHBbOiV-hRrdMXuy13iZZ6hvCfk-vTWz4vq2ula5Qwq5GKAKhC7pohxgL-mMXAkQ0I8c07z_L-klhBhC6mFKTl8PgxIghG2kxSHmXvGruMCHGJe1XXCXlDVgGJeXVlaQZZep4KSMSbhku1jx5l6fL00FOe6C27ag91K3fk98 Jul 05 16:14:13.147452 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:14:13.147452 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:14:13.147452 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:14:13.147452 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:14:13.147452 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:14:13.147452 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:14:13.147452 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 42e6ad67dbf542528726c545872ac10c Jul 05 16:14:13.147452 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:14:13.147452 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:14:13.147452 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:14:13.149074 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_42e6ad67dbf542528726c545872ac10c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:14:13.149074 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:14:13.149074 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 42e6ad67dbf542528726c545872ac10c Jul 05 16:14:13.149074 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:14:13.149074 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-AttachVolumeNegativeTest-547019280-project Jul 05 16:14:13.149074 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:14:13.149074 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:14:13.149074 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: 0c8512e7c1704fac9cc4fcfe3bf1f18b Jul 05 16:14:13.149074 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-AttachVolumeNegativeTest-547019280-project Jul 05 16:14:13.149074 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:14:13.149074 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance 1f42f67a-5eab-461d-9467-84aea8666852 could not be found. Jul 05 16:14:13.149074 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': '1f42f67a-5eab-461d-9467-84aea8666852'} Jul 05 16:14:13.149871 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:14:13.149871 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:14:13.149871 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:14:13.149871 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:14:13.149871 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:14:13.149871 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:14:13.149871 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:14:13.149871 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:14:13.149871 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:14:13.149871 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:14:13.149871 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f42f67a-5eab-461d-9467-84aea8666852 could not be found. Jul 05 16:14:13.149871 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:13.149871 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:14:13.149871 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:13.149871 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:14:13.149871 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:14:13.149871 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:14:13.149871 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:14:13.149871 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:14:13.149871 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:14:13.151387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:14:13.151387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 16:14:13.151387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 16:14:13.151387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:14:13.151387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:14:13.151387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:14:13.151387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:14:13.151387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f42f67a-5eab-461d-9467-84aea8666852 could not be found. Jul 05 16:14:13.151387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:13.151387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:14:13.151387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:13.151387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:14:13.151387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:14:13.151387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:14:13.151387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:14:13.151387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:14:13.151387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f42f67a-5eab-461d-9467-84aea8666852 could not be found. Jul 05 16:14:13.151387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:13.153295 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-4ba5ce3e-56a5-40e7-ae74-66f9e0293e56 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Returning 404 to user: Instance 1f42f67a-5eab-461d-9467-84aea8666852 could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:14:13.153295 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-4ba5ce3e-56a5-40e7-ae74-66f9e0293e56 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852" status: 404 len: 111 microversion: 2.1 time: 0.184764 Jul 05 16:14:13.153295 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 370/738] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:12 2022] GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852 => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 16:14:13.158281 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-062eff36-3e9d-468e-975c-acfe982fbc82 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '.version_select at 0x7f3087e3d940>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:13.250340 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-062eff36-3e9d-468e-975c-acfe982fbc82 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2084398981" status: 202 len: 0 microversion: 2.1 time: 0.096155 Jul 05 16:14:13.250842 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 369/739] 10.222.0.45 () {58 vars in 1220 bytes} [Tue Jul 5 16:14:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2084398981 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 16:14:13.472873 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-141094b5-eb66-45c4-96d5-19a3b1f315dc tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:13.473494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-141094b5-eb66-45c4-96d5-19a3b1f315dc tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 42be8657-fc50-4057-b373-e7bcf984e261] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:13.480283 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-141094b5-eb66-45c4-96d5-19a3b1f315dc tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:13.480727 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-141094b5-eb66-45c4-96d5-19a3b1f315dc tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:13.481543 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-141094b5-eb66-45c4-96d5-19a3b1f315dc tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:13.482563 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-141094b5-eb66-45c4-96d5-19a3b1f315dc tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:13.497758 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:13.508706 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-141094b5-eb66-45c4-96d5-19a3b1f315dc tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] HTTP exception thrown: Instance 42be8657-fc50-4057-b373-e7bcf984e261 could not be found. Jul 05 16:14:13.510330 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-141094b5-eb66-45c4-96d5-19a3b1f315dc tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Request method failure captured: Jul 05 16:14:13.510330 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 HTTP/1.1 Jul 05 16:14:13.510330 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:14:13.510330 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:14:13.510330 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:14:13.510330 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:14:13.510330 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:14:13.510330 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:14:13.510330 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:14:13.510330 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:14:13.510330 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIbm-fGDoYcXhi-DiBd_EHf54mABU16-lVoqKUsmzMxPfvtZz3cDR_eLFLAUXUkaoXiE_x_JaCy2K0M-p1S_UwLA--ZfDF_Efr5SkiXjg8KEFbKA2u7SIH1VdWaoghMLl3WnWI8g3GmnhK30BicBR2S2x7Pflc_2x-DFM7Iz5W2JHg Jul 05 16:14:13.510330 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:14:13.510330 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:14:13.510330 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:14:13.510330 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:14:13.510330 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:14:13.510330 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:14:13.510330 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: bbe6a2de3cba4aa7b365f30f5b2f745c Jul 05 16:14:13.510330 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1117569186 Jul 05 16:14:13.510330 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:14:13.510330 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:14:13.515205 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bbe6a2de3cba4aa7b365f30f5b2f745c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bbe6a2de3cba4aa7b365f30f5b2f745c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bbe6a2de3cba4aa7b365f30f5b2f745c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bbe6a2de3cba4aa7b365f30f5b2f745c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:14:13.515205 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1117569186 Jul 05 16:14:13.515205 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: bbe6a2de3cba4aa7b365f30f5b2f745c Jul 05 16:14:13.515205 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1117569186 Jul 05 16:14:13.515205 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-ServerRescueNegativeTestJSON-1117569186-project Jul 05 16:14:13.515205 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:14:13.515205 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:14:13.515205 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: 8b6e665914774eabba120e986e6bb282 Jul 05 16:14:13.515205 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1117569186-project Jul 05 16:14:13.515205 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:14:13.515205 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance 42be8657-fc50-4057-b373-e7bcf984e261 could not be found. Jul 05 16:14:13.515205 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': '42be8657-fc50-4057-b373-e7bcf984e261'} Jul 05 16:14:13.516213 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:14:13.516213 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:14:13.516213 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:14:13.516213 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:14:13.516213 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:14:13.516213 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:14:13.516213 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:14:13.516213 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:14:13.516213 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:14:13.516213 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:14:13.516213 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42be8657-fc50-4057-b373-e7bcf984e261 could not be found. Jul 05 16:14:13.516213 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:13.516213 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:14:13.516213 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:13.516213 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:14:13.516213 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:14:13.516213 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:14:13.516213 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:14:13.516213 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:14:13.516213 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:14:13.517717 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:14:13.517717 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 16:14:13.517717 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 16:14:13.517717 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:14:13.517717 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:14:13.517717 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:14:13.517717 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:14:13.517717 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42be8657-fc50-4057-b373-e7bcf984e261 could not be found. Jul 05 16:14:13.517717 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:13.517717 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:14:13.517717 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:13.517717 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:14:13.517717 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:14:13.517717 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:14:13.517717 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:14:13.517717 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:14:13.517717 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42be8657-fc50-4057-b373-e7bcf984e261 could not be found. Jul 05 16:14:13.517717 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:13.518981 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-141094b5-eb66-45c4-96d5-19a3b1f315dc tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Returning 404 to user: Instance 42be8657-fc50-4057-b373-e7bcf984e261 could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:14:13.518981 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-141094b5-eb66-45c4-96d5-19a3b1f315dc tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261" status: 404 len: 111 microversion: 2.1 time: 0.042909 Jul 05 16:14:13.518981 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 371/740] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:13 2022] GET /compute/v2.1/servers/42be8657-fc50-4057-b373-e7bcf984e261 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 16:14:13.520484 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-6332db72-8527-4d68-8531-38f10a9d603a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '.version_select at 0x7f3087df0310>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:13.582201 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-70e249c8-d9c2-4e7e-82cb-e470a2ccc8bf req-b7c25593-aeeb-495f-8c7b-35e8b137dd3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42be8657-fc50-4057-b373-e7bcf984e261", "name": "network-vif-deleted", "tag": "81587e02-fcd0-4999-9ed7-aae4729b5548"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:14:13.591653 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-70e249c8-d9c2-4e7e-82cb-e470a2ccc8bf req-b7c25593-aeeb-495f-8c7b-35e8b137dd3e service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:13.592099 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-70e249c8-d9c2-4e7e-82cb-e470a2ccc8bf req-b7c25593-aeeb-495f-8c7b-35e8b137dd3e service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:13.597776 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-6332db72-8527-4d68-8531-38f10a9d603a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-407624647" status: 202 len: 0 microversion: 2.1 time: 0.081038 Jul 05 16:14:13.598704 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 370/741] 10.222.0.45 () {58 vars in 1217 bytes} [Tue Jul 5 16:14:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-407624647 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 16:14:13.604492 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-70e249c8-d9c2-4e7e-82cb-e470a2ccc8bf req-b7c25593-aeeb-495f-8c7b-35e8b137dd3e service nova] Creating event network-vif-deleted:81587e02-fcd0-4999-9ed7-aae4729b5548 for instance 42be8657-fc50-4057-b373-e7bcf984e261 on hv-cinder-84875 Jul 05 16:14:13.609527 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-70e249c8-d9c2-4e7e-82cb-e470a2ccc8bf req-b7c25593-aeeb-495f-8c7b-35e8b137dd3e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031042 Jul 05 16:14:13.610643 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 372/742] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:14:14.043548 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-01148b18-b58b-4c17-bd1b-77ffd275e1e1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Action: 'create', calling method: .version_select at 0x7f309877be50>, body: {"keypair": {"name": "tempest-keypair-1890608426", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8sU3mDWWf1tqVf5af4bpQeWBpmwDGuubc1YqzUgzqewW1d5AR7f86IIqCKa1vt4i6OlPTn3YIXMd/E4O8RGcd61TqbW8MidykFp+iyMOw78rbqgQTGxK3D4NBeujV8QQ=="}} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:14:14.059846 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.quota [None req-01148b18-b58b-4c17-bd1b-77ffd275e1e1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Getting quotas for project 42e6ad67dbf542528726c545872ac10c. Resources: {'key_pairs'} {{(pid=118319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:14:14.063617 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.quota [None req-01148b18-b58b-4c17-bd1b-77ffd275e1e1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Getting quotas for user 0c8512e7c1704fac9cc4fcfe3bf1f18b and project 42e6ad67dbf542528726c545872ac10c. Resources: {'key_pairs'} {{(pid=118319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:14:14.135483 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-01148b18-b58b-4c17-bd1b-77ffd275e1e1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.095952 Jul 05 16:14:14.136280 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 371/743] 10.222.0.45 () {60 vars in 1158 bytes} [Tue Jul 5 16:14:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:14:16.395821 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-869f5f0e-cc08-4360-b977-38dce3dd7dcc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-637644252", "imageRef": "c5805086-2ebd-4742-8185-f79894fef91e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "77ec7356-4bd9-42af-abe3-f1b9c525bdef"}], "security_groups": [{"name": "tempest-securitygroup--233641785"}], "key_name": "tempest-keypair-1890608426", "user_data": "}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:14:16.497509 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.network.neutron [None req-869f5f0e-cc08-4360-b977-38dce3dd7dcc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] validate_networks() for [('77ec7356-4bd9-42af-abe3-f1b9c525bdef', None, None, None, None, None)] {{(pid=118320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 16:14:16.687593 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-c092f911-bb91-40cb-a6ab-4ab2096a67a8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:16.688211 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-c092f911-bb91-40cb-a6ab-4ab2096a67a8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:16.690223 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:16.695701 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c092f911-bb91-40cb-a6ab-4ab2096a67a8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:16.697886 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c092f911-bb91-40cb-a6ab-4ab2096a67a8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:16.697886 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c092f911-bb91-40cb-a6ab-4ab2096a67a8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:16.697886 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c092f911-bb91-40cb-a6ab-4ab2096a67a8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:16.720381 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-c092f911-bb91-40cb-a6ab-4ab2096a67a8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a/ips" status: 200 len: 150 microversion: 2.20 time: 0.095802 Jul 05 16:14:16.720960 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 372/744] 10.222.0.45 () {60 vars in 1288 bytes} [Tue Jul 5 16:14:16 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a/ips => generated 150 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 05 16:14:16.906114 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-869f5f0e-cc08-4360-b977-38dce3dd7dcc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Flavor limits 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 16:14:16.906639 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-869f5f0e-cc08-4360-b977-38dce3dd7dcc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Image limits 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 16:14:16.907112 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-869f5f0e-cc08-4360-b977-38dce3dd7dcc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Flavor pref 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 16:14:16.907519 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-869f5f0e-cc08-4360-b977-38dce3dd7dcc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Image pref 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 16:14:16.907938 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-869f5f0e-cc08-4360-b977-38dce3dd7dcc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 16:14:16.917476 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-869f5f0e-cc08-4360-b977-38dce3dd7dcc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:16.917893 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-869f5f0e-cc08-4360-b977-38dce3dd7dcc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:16.918688 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-869f5f0e-cc08-4360-b977-38dce3dd7dcc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:16.919125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-869f5f0e-cc08-4360-b977-38dce3dd7dcc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:16.937278 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-869f5f0e-cc08-4360-b977-38dce3dd7dcc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Getting quotas for project 42e6ad67dbf542528726c545872ac10c. Resources: {'ram', 'instances', 'cores'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:14:16.941711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-869f5f0e-cc08-4360-b977-38dce3dd7dcc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Getting quotas for user 0c8512e7c1704fac9cc4fcfe3bf1f18b and project 42e6ad67dbf542528726c545872ac10c. Resources: {'ram', 'instances', 'cores'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:14:16.942114 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-7592b85c-021b-454d-9835-96a7b6ae58d4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:16.942688 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-7592b85c-021b-454d-9835-96a7b6ae58d4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:16.949203 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7592b85c-021b-454d-9835-96a7b6ae58d4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:16.949686 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7592b85c-021b-454d-9835-96a7b6ae58d4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:16.950454 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7592b85c-021b-454d-9835-96a7b6ae58d4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:16.950894 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7592b85c-021b-454d-9835-96a7b6ae58d4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:16.952870 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-869f5f0e-cc08-4360-b977-38dce3dd7dcc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Going to run 1 instances... {{(pid=118320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 16:14:16.955289 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-869f5f0e-cc08-4360-b977-38dce3dd7dcc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5805086-2ebd-4742-8185-f79894fef91e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 16:14:16.977850 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-7592b85c-021b-454d-9835-96a7b6ae58d4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Going to try to terminate instance {{(pid=118319) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 16:14:17.111669 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-869f5f0e-cc08-4360-b977-38dce3dd7dcc tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.721143 Jul 05 16:14:17.112522 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 373/745] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Jul 5 16:14:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 16:14:17.122359 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-93667132-caf5-483f-9496-38a5f8b63909 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:17.122971 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-93667132-caf5-483f-9496-38a5f8b63909 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:17.180158 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-93667132-caf5-483f-9496-38a5f8b63909 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:17.187484 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-93667132-caf5-483f-9496-38a5f8b63909 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39" status: 200 len: 1241 microversion: 2.1 time: 0.068758 Jul 05 16:14:17.188038 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 374/746] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:17 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:14:17.341981 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-7592b85c-021b-454d-9835-96a7b6ae58d4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 204 len: 0 microversion: 2.1 time: 0.404032 Jul 05 16:14:17.342578 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 373/747] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Jul 5 16:14:16 2022] DELETE /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 05 16:14:17.351127 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-6913735c-a6b8-4517-ac3d-f4400e200386 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:17.351736 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-6913735c-a6b8-4517-ac3d-f4400e200386 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:17.368325 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6913735c-a6b8-4517-ac3d-f4400e200386 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:17.368806 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6913735c-a6b8-4517-ac3d-f4400e200386 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:17.369577 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6913735c-a6b8-4517-ac3d-f4400e200386 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:17.370011 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6913735c-a6b8-4517-ac3d-f4400e200386 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:17.504463 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-6913735c-a6b8-4517-ac3d-f4400e200386 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:17.512443 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-6913735c-a6b8-4517-ac3d-f4400e200386 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1507 microversion: 2.1 time: 0.165845 Jul 05 16:14:17.513058 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 375/748] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:17 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:18.205478 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-d931d63c-ad26-44cf-b7af-5587b4557c41 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:18.206237 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-d931d63c-ad26-44cf-b7af-5587b4557c41 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:18.212673 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d931d63c-ad26-44cf-b7af-5587b4557c41 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:18.213152 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d931d63c-ad26-44cf-b7af-5587b4557c41 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:18.213911 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d931d63c-ad26-44cf-b7af-5587b4557c41 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:18.214349 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d931d63c-ad26-44cf-b7af-5587b4557c41 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:18.274974 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-d931d63c-ad26-44cf-b7af-5587b4557c41 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:18.282561 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-d931d63c-ad26-44cf-b7af-5587b4557c41 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39" status: 200 len: 1245 microversion: 2.1 time: 0.081274 Jul 05 16:14:18.283120 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 374/749] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:18 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:18.532880 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-388dd0f9-0d90-42e8-b5d2-7eddeac8c2b1 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:18.532880 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-388dd0f9-0d90-42e8-b5d2-7eddeac8c2b1 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:18.538596 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-388dd0f9-0d90-42e8-b5d2-7eddeac8c2b1 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:18.539050 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-388dd0f9-0d90-42e8-b5d2-7eddeac8c2b1 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:18.539808 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-388dd0f9-0d90-42e8-b5d2-7eddeac8c2b1 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:18.540243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-388dd0f9-0d90-42e8-b5d2-7eddeac8c2b1 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:18.669434 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-388dd0f9-0d90-42e8-b5d2-7eddeac8c2b1 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:18.677318 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-388dd0f9-0d90-42e8-b5d2-7eddeac8c2b1 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1507 microversion: 2.1 time: 0.150740 Jul 05 16:14:18.677891 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 376/750] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:18 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:19.299808 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-a7fd67bf-3cdb-4681-ba55-8e08041da0eb tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:19.300422 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-a7fd67bf-3cdb-4681-ba55-8e08041da0eb tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:19.307604 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a7fd67bf-3cdb-4681-ba55-8e08041da0eb tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:19.308047 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a7fd67bf-3cdb-4681-ba55-8e08041da0eb tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:19.308827 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a7fd67bf-3cdb-4681-ba55-8e08041da0eb tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:19.309261 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a7fd67bf-3cdb-4681-ba55-8e08041da0eb tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:19.371862 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-a7fd67bf-3cdb-4681-ba55-8e08041da0eb tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:19.379244 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-a7fd67bf-3cdb-4681-ba55-8e08041da0eb tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39" status: 200 len: 1245 microversion: 2.1 time: 0.083328 Jul 05 16:14:19.379807 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 375/751] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:19 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:19.693931 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-49bb507b-f4e6-4a8f-85e5-144f57b6dcb6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:19.694545 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-49bb507b-f4e6-4a8f-85e5-144f57b6dcb6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:19.701679 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-49bb507b-f4e6-4a8f-85e5-144f57b6dcb6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:19.702128 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-49bb507b-f4e6-4a8f-85e5-144f57b6dcb6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:19.702884 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-49bb507b-f4e6-4a8f-85e5-144f57b6dcb6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:19.703318 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-49bb507b-f4e6-4a8f-85e5-144f57b6dcb6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:19.832829 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-49bb507b-f4e6-4a8f-85e5-144f57b6dcb6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:19.841163 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-49bb507b-f4e6-4a8f-85e5-144f57b6dcb6 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1507 microversion: 2.1 time: 0.151186 Jul 05 16:14:19.842270 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 377/752] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:19 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:20.059468 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-9993e778-ef75-43fd-a49c-a69bf52d1874 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:14:20.060006 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-9993e778-ef75-43fd-a49c-a69bf52d1874 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:20.066136 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9993e778-ef75-43fd-a49c-a69bf52d1874 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:20.066860 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9993e778-ef75-43fd-a49c-a69bf52d1874 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:20.067321 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9993e778-ef75-43fd-a49c-a69bf52d1874 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:20.067748 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9993e778-ef75-43fd-a49c-a69bf52d1874 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:20.092644 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.objects.instance [None req-9993e778-ef75-43fd-a49c-a69bf52d1874 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lazy-loading 'flavor' on Instance uuid 33b7b310-f555-460e-a187-4940bb9df69a {{(pid=118319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 16:14:20.397456 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-c589ec16-a41b-41fc-baca-c024dabd4fc8 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:20.399531 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-c589ec16-a41b-41fc-baca-c024dabd4fc8 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:20.410556 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c589ec16-a41b-41fc-baca-c024dabd4fc8 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:20.411290 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c589ec16-a41b-41fc-baca-c024dabd4fc8 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:20.412251 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c589ec16-a41b-41fc-baca-c024dabd4fc8 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:20.412901 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c589ec16-a41b-41fc-baca-c024dabd4fc8 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:20.493754 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c589ec16-a41b-41fc-baca-c024dabd4fc8 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:20.501856 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-c589ec16-a41b-41fc-baca-c024dabd4fc8 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39" status: 200 len: 1293 microversion: 2.1 time: 0.108400 Jul 05 16:14:20.502855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 378/753] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:20 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39 => generated 1293 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:20.507983 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-9bf21d8e-80e9-48ae-8909-29a830528c78 req-24814b75-b9cb-4776-aa64-02aa4f7f53eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d712774-90eb-4130-916f-046ba6b891a0", "name": "network-vif-deleted", "tag": "426e703b-fda9-4cb3-9ba0-62242cbd02d2"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:14:20.518110 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-9bf21d8e-80e9-48ae-8909-29a830528c78 req-24814b75-b9cb-4776-aa64-02aa4f7f53eb service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:20.520087 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-9bf21d8e-80e9-48ae-8909-29a830528c78 req-24814b75-b9cb-4776-aa64-02aa4f7f53eb service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:20.531047 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-9bf21d8e-80e9-48ae-8909-29a830528c78 req-24814b75-b9cb-4776-aa64-02aa4f7f53eb service nova] Creating event network-vif-deleted:426e703b-fda9-4cb3-9ba0-62242cbd02d2 for instance 2d712774-90eb-4130-916f-046ba6b891a0 on hv-cinder-84875 Jul 05 16:14:20.536285 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-9bf21d8e-80e9-48ae-8909-29a830528c78 req-24814b75-b9cb-4776-aa64-02aa4f7f53eb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032095 Jul 05 16:14:20.537332 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 379/754] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:14:20.666690 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-9993e778-ef75-43fd-a49c-a69bf52d1874 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "POST /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a/action" status: 202 len: 0 microversion: 2.20 time: 0.606995 Jul 05 16:14:20.666690 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 376/755] 10.222.0.45 () {62 vars in 1318 bytes} [Tue Jul 5 16:14:20 2022] POST /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a/action => generated 0 bytes in 609 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 05 16:14:20.673116 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-e519a742-5773-4e02-987e-0a8902b1b870 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:20.673828 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-e519a742-5773-4e02-987e-0a8902b1b870 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:20.680667 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e519a742-5773-4e02-987e-0a8902b1b870 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:20.681264 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e519a742-5773-4e02-987e-0a8902b1b870 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:20.682052 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e519a742-5773-4e02-987e-0a8902b1b870 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:20.682495 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e519a742-5773-4e02-987e-0a8902b1b870 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:20.861056 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-b05c50ba-522b-4180-a9c3-ab7e6e033f7f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:20.861303 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-b05c50ba-522b-4180-a9c3-ab7e6e033f7f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:20.868365 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b05c50ba-522b-4180-a9c3-ab7e6e033f7f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:20.868991 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b05c50ba-522b-4180-a9c3-ab7e6e033f7f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:20.869777 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b05c50ba-522b-4180-a9c3-ab7e6e033f7f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:20.870214 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b05c50ba-522b-4180-a9c3-ab7e6e033f7f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:20.891343 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-e519a742-5773-4e02-987e-0a8902b1b870 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:20.898307 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-e519a742-5773-4e02-987e-0a8902b1b870 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:20.899963 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-e519a742-5773-4e02-987e-0a8902b1b870 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:20.901176 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-e519a742-5773-4e02-987e-0a8902b1b870 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1721 microversion: 2.20 time: 0.233131 Jul 05 16:14:20.901745 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 380/756] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:14:20 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1721 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:14:20.909812 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b05c50ba-522b-4180-a9c3-ab7e6e033f7f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:20.910596 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b05c50ba-522b-4180-a9c3-ab7e6e033f7f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:20.911090 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.objects.instance [None req-b05c50ba-522b-4180-a9c3-ab7e6e033f7f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lazy-loading 'fault' on Instance uuid 2d712774-90eb-4130-916f-046ba6b891a0 {{(pid=118319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 16:14:20.977224 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-b05c50ba-522b-4180-a9c3-ab7e6e033f7f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:20.984912 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-b05c50ba-522b-4180-a9c3-ab7e6e033f7f tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 200 len: 1311 microversion: 2.1 time: 0.130219 Jul 05 16:14:20.985491 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 377/757] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:20 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 1311 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:14:21.519958 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-40b5f337-36d3-4b74-a061-d08f9b00a80a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:21.524573 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-40b5f337-36d3-4b74-a061-d08f9b00a80a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:21.528048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-40b5f337-36d3-4b74-a061-d08f9b00a80a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:21.528694 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-40b5f337-36d3-4b74-a061-d08f9b00a80a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:21.529732 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-40b5f337-36d3-4b74-a061-d08f9b00a80a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:21.530399 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-40b5f337-36d3-4b74-a061-d08f9b00a80a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:21.692447 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-40b5f337-36d3-4b74-a061-d08f9b00a80a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:21.702052 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-40b5f337-36d3-4b74-a061-d08f9b00a80a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39" status: 200 len: 1366 microversion: 2.1 time: 0.185899 Jul 05 16:14:21.702905 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 381/758] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:21 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:21.920191 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-a067b067-c1aa-40fa-85e9-94a06bdcc43d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:21.920844 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-a067b067-c1aa-40fa-85e9-94a06bdcc43d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:21.927601 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a067b067-c1aa-40fa-85e9-94a06bdcc43d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:21.928047 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a067b067-c1aa-40fa-85e9-94a06bdcc43d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:21.928837 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a067b067-c1aa-40fa-85e9-94a06bdcc43d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:21.929271 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a067b067-c1aa-40fa-85e9-94a06bdcc43d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:22.003681 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-0f14b777-c0d3-49fa-9114-e09c3b68f9eb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:22.004963 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-0f14b777-c0d3-49fa-9114-e09c3b68f9eb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 2d712774-90eb-4130-916f-046ba6b891a0] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:22.011607 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0f14b777-c0d3-49fa-9114-e09c3b68f9eb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:22.012145 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0f14b777-c0d3-49fa-9114-e09c3b68f9eb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:22.013035 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0f14b777-c0d3-49fa-9114-e09c3b68f9eb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:22.013851 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0f14b777-c0d3-49fa-9114-e09c3b68f9eb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:22.028681 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-0f14b777-c0d3-49fa-9114-e09c3b68f9eb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] HTTP exception thrown: Instance 2d712774-90eb-4130-916f-046ba6b891a0 could not be found. Jul 05 16:14:22.030470 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-0f14b777-c0d3-49fa-9114-e09c3b68f9eb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Request method failure captured: Jul 05 16:14:22.030470 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 HTTP/1.1 Jul 05 16:14:22.030470 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:14:22.030470 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:14:22.030470 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:14:22.030470 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:14:22.030470 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:14:22.030470 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:14:22.030470 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:14:22.030470 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:14:22.030470 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIbm-fGDoYcXhi-DiBd_EHf54mABU16-lVoqKUsmzMxPfvtZz3cDR_eLFLAUXUkaoXiE_x_JaCy2K0M-p1S_UwLA--ZfDF_Efr5SkiXjg8KEFbKA2u7SIH1VdWaoghMLl3WnWI8g3GmnhK30BicBR2S2x7Pflc_2x-DFM7Iz5W2JHg Jul 05 16:14:22.030470 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:14:22.030470 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:14:22.030470 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:14:22.030470 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:14:22.030470 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:14:22.030470 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:14:22.030470 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: bbe6a2de3cba4aa7b365f30f5b2f745c Jul 05 16:14:22.030470 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1117569186 Jul 05 16:14:22.030470 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:14:22.030470 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:14:22.031763 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bbe6a2de3cba4aa7b365f30f5b2f745c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bbe6a2de3cba4aa7b365f30f5b2f745c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bbe6a2de3cba4aa7b365f30f5b2f745c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bbe6a2de3cba4aa7b365f30f5b2f745c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:14:22.031763 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1117569186 Jul 05 16:14:22.031763 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: bbe6a2de3cba4aa7b365f30f5b2f745c Jul 05 16:14:22.031763 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1117569186 Jul 05 16:14:22.031763 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-ServerRescueNegativeTestJSON-1117569186-project Jul 05 16:14:22.031763 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:14:22.031763 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:14:22.031763 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: 8b6e665914774eabba120e986e6bb282 Jul 05 16:14:22.031763 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1117569186-project Jul 05 16:14:22.031763 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:14:22.031763 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance 2d712774-90eb-4130-916f-046ba6b891a0 could not be found. Jul 05 16:14:22.031763 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': '2d712774-90eb-4130-916f-046ba6b891a0'} Jul 05 16:14:22.032484 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:14:22.032484 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:14:22.032484 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:14:22.032484 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:14:22.032484 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:14:22.032484 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:14:22.032484 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:14:22.032484 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:14:22.032484 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:14:22.032484 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:14:22.032484 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d712774-90eb-4130-916f-046ba6b891a0 could not be found. Jul 05 16:14:22.032484 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:22.032484 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:14:22.032484 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:22.032484 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:14:22.032484 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:14:22.032484 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:14:22.032484 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:14:22.032484 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:14:22.032484 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:14:22.034264 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:14:22.034264 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 16:14:22.034264 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 16:14:22.034264 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:14:22.034264 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:14:22.034264 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:14:22.034264 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:14:22.034264 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d712774-90eb-4130-916f-046ba6b891a0 could not be found. Jul 05 16:14:22.034264 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:22.034264 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:14:22.034264 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:22.034264 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:14:22.034264 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:14:22.034264 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:14:22.034264 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:14:22.034264 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:14:22.034264 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d712774-90eb-4130-916f-046ba6b891a0 could not be found. Jul 05 16:14:22.034264 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:22.035702 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-0f14b777-c0d3-49fa-9114-e09c3b68f9eb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Returning 404 to user: Instance 2d712774-90eb-4130-916f-046ba6b891a0 could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:14:22.035702 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-0f14b777-c0d3-49fa-9114-e09c3b68f9eb tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0" status: 404 len: 111 microversion: 2.1 time: 0.032712 Jul 05 16:14:22.035983 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 382/759] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:21 2022] GET /compute/v2.1/servers/2d712774-90eb-4130-916f-046ba6b891a0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 16:14:22.041071 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-b9b09cf0-3ad4-40db-b509-b7b6045dc14a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:22.041576 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-b9b09cf0-3ad4-40db-b509-b7b6045dc14a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:22.047459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b9b09cf0-3ad4-40db-b509-b7b6045dc14a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:22.047914 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b9b09cf0-3ad4-40db-b509-b7b6045dc14a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:22.048683 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b9b09cf0-3ad4-40db-b509-b7b6045dc14a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:22.049146 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b9b09cf0-3ad4-40db-b509-b7b6045dc14a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:22.075009 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-b9b09cf0-3ad4-40db-b509-b7b6045dc14a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Going to try to terminate instance {{(pid=118320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 16:14:22.151546 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-a067b067-c1aa-40fa-85e9-94a06bdcc43d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:22.159829 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-a067b067-c1aa-40fa-85e9-94a06bdcc43d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:22.161478 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-a067b067-c1aa-40fa-85e9-94a06bdcc43d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:22.162834 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-a067b067-c1aa-40fa-85e9-94a06bdcc43d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1721 microversion: 2.20 time: 0.247093 Jul 05 16:14:22.164069 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 378/760] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:14:21 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1721 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:14:22.402628 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-b9b09cf0-3ad4-40db-b509-b7b6045dc14a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 204 len: 0 microversion: 2.1 time: 0.365410 Jul 05 16:14:22.403373 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 383/761] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Jul 5 16:14:22 2022] DELETE /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 16:14:22.412303 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-73dedd03-8c42-41ad-a7d0-09b4d7db1fe4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:22.413224 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-73dedd03-8c42-41ad-a7d0-09b4d7db1fe4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:22.420078 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-73dedd03-8c42-41ad-a7d0-09b4d7db1fe4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:22.420826 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-73dedd03-8c42-41ad-a7d0-09b4d7db1fe4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:22.421626 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-73dedd03-8c42-41ad-a7d0-09b4d7db1fe4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:22.422062 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-73dedd03-8c42-41ad-a7d0-09b4d7db1fe4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:22.707132 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-73dedd03-8c42-41ad-a7d0-09b4d7db1fe4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:22.716499 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-73dedd03-8c42-41ad-a7d0-09b4d7db1fe4 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1521 microversion: 2.1 time: 0.308580 Jul 05 16:14:22.719785 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 379/762] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:22 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:14:22.720170 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-5fbe887d-6ed3-48f9-a9c5-2ef697a906ee tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:22.720900 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-5fbe887d-6ed3-48f9-a9c5-2ef697a906ee tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:22.728242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5fbe887d-6ed3-48f9-a9c5-2ef697a906ee tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:22.728687 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5fbe887d-6ed3-48f9-a9c5-2ef697a906ee tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:22.729487 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5fbe887d-6ed3-48f9-a9c5-2ef697a906ee tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:22.729917 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5fbe887d-6ed3-48f9-a9c5-2ef697a906ee tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:22.901389 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [req-2a55efc2-d3bd-43fb-a80c-714e74a9787b req-636fa2f4-4273-4f12-863f-a0f5eea6e0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52a25436-864d-4302-9b41-f9f904dfaa39", "tag": "9ac8cbc0-45bd-47dc-8eb3-b69db5ea2a18"}]} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:14:22.910410 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-2a55efc2-d3bd-43fb-a80c-714e74a9787b req-636fa2f4-4273-4f12-863f-a0f5eea6e0a4 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:22.911130 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-2a55efc2-d3bd-43fb-a80c-714e74a9787b req-636fa2f4-4273-4f12-863f-a0f5eea6e0a4 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:22.915439 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-5fbe887d-6ed3-48f9-a9c5-2ef697a906ee tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:22.924133 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.compute.server_external_events [req-2a55efc2-d3bd-43fb-a80c-714e74a9787b req-636fa2f4-4273-4f12-863f-a0f5eea6e0a4 service nova] Creating event network-changed:9ac8cbc0-45bd-47dc-8eb3-b69db5ea2a18 for instance 52a25436-864d-4302-9b41-f9f904dfaa39 on hv-cinder-84875 Jul 05 16:14:22.929985 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [req-2a55efc2-d3bd-43fb-a80c-714e74a9787b req-636fa2f4-4273-4f12-863f-a0f5eea6e0a4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031969 Jul 05 16:14:22.932576 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 380/763] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:14:22.935083 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-5fbe887d-6ed3-48f9-a9c5-2ef697a906ee tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39" status: 200 len: 1366 microversion: 2.1 time: 0.219231 Jul 05 16:14:22.935660 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 384/764] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:22 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:14:23.184238 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-c3b5c4ee-b390-44c9-8217-f291a09b8f60 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:23.184812 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-c3b5c4ee-b390-44c9-8217-f291a09b8f60 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:23.191776 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c3b5c4ee-b390-44c9-8217-f291a09b8f60 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:23.192196 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c3b5c4ee-b390-44c9-8217-f291a09b8f60 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:23.193062 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c3b5c4ee-b390-44c9-8217-f291a09b8f60 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:23.193502 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-c3b5c4ee-b390-44c9-8217-f291a09b8f60 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:23.325331 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-c3b5c4ee-b390-44c9-8217-f291a09b8f60 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:23.333226 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-c3b5c4ee-b390-44c9-8217-f291a09b8f60 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:23.335812 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-c3b5c4ee-b390-44c9-8217-f291a09b8f60 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:23.335944 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-c3b5c4ee-b390-44c9-8217-f291a09b8f60 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1721 microversion: 2.20 time: 0.157036 Jul 05 16:14:23.336428 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 381/765] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:14:23 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:14:23.735067 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-3246ce44-7bd4-42db-9cc1-71fab9309c3a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:23.735688 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-3246ce44-7bd4-42db-9cc1-71fab9309c3a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:23.742293 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3246ce44-7bd4-42db-9cc1-71fab9309c3a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:23.742736 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3246ce44-7bd4-42db-9cc1-71fab9309c3a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:23.743494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3246ce44-7bd4-42db-9cc1-71fab9309c3a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:23.743925 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3246ce44-7bd4-42db-9cc1-71fab9309c3a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:23.871030 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-3246ce44-7bd4-42db-9cc1-71fab9309c3a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:23.878280 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-3246ce44-7bd4-42db-9cc1-71fab9309c3a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1521 microversion: 2.1 time: 0.147336 Jul 05 16:14:23.878839 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 385/766] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:23 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:23.952099 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-f74f0bba-0890-4d46-899c-207b35ac417c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:23.952718 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-f74f0bba-0890-4d46-899c-207b35ac417c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:23.959221 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f74f0bba-0890-4d46-899c-207b35ac417c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:23.959676 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f74f0bba-0890-4d46-899c-207b35ac417c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:23.960981 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f74f0bba-0890-4d46-899c-207b35ac417c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:23.961421 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f74f0bba-0890-4d46-899c-207b35ac417c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:24.071418 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell0:SELECT=4 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:24.102750 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-f74f0bba-0890-4d46-899c-207b35ac417c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:24.110369 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-f74f0bba-0890-4d46-899c-207b35ac417c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39" status: 200 len: 1366 microversion: 2.1 time: 0.162189 Jul 05 16:14:24.110929 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 382/767] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:23 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:24.354481 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-eefd8744-735e-4441-9655-04dbab0a73f1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:24.355096 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-eefd8744-735e-4441-9655-04dbab0a73f1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:24.362906 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-eefd8744-735e-4441-9655-04dbab0a73f1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:24.363401 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-eefd8744-735e-4441-9655-04dbab0a73f1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:24.364177 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-eefd8744-735e-4441-9655-04dbab0a73f1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:24.364620 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-eefd8744-735e-4441-9655-04dbab0a73f1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:24.490248 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-eefd8744-735e-4441-9655-04dbab0a73f1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:24.498688 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-eefd8744-735e-4441-9655-04dbab0a73f1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:24.500183 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-eefd8744-735e-4441-9655-04dbab0a73f1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:24.501366 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-eefd8744-735e-4441-9655-04dbab0a73f1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1721 microversion: 2.20 time: 0.151489 Jul 05 16:14:24.501915 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 386/768] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:14:24 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:14:24.895135 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-b17ca946-4a66-402c-bdbe-c398f8ea4141 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:24.895782 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-b17ca946-4a66-402c-bdbe-c398f8ea4141 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:24.902782 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b17ca946-4a66-402c-bdbe-c398f8ea4141 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:24.903236 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b17ca946-4a66-402c-bdbe-c398f8ea4141 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:24.904014 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b17ca946-4a66-402c-bdbe-c398f8ea4141 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:24.904457 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b17ca946-4a66-402c-bdbe-c398f8ea4141 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:25.031218 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-b17ca946-4a66-402c-bdbe-c398f8ea4141 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:25.038803 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-b17ca946-4a66-402c-bdbe-c398f8ea4141 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1521 microversion: 2.1 time: 0.147533 Jul 05 16:14:25.039371 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 383/769] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:24 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:25.126972 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-7989d248-e346-4f07-92ea-8ae75d40c13c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:25.127608 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-7989d248-e346-4f07-92ea-8ae75d40c13c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:25.134579 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7989d248-e346-4f07-92ea-8ae75d40c13c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:25.135030 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7989d248-e346-4f07-92ea-8ae75d40c13c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:25.135790 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7989d248-e346-4f07-92ea-8ae75d40c13c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:25.136226 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7989d248-e346-4f07-92ea-8ae75d40c13c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:25.261999 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-7989d248-e346-4f07-92ea-8ae75d40c13c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:25.269302 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-7989d248-e346-4f07-92ea-8ae75d40c13c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39" status: 200 len: 1366 microversion: 2.1 time: 0.146115 Jul 05 16:14:25.269874 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 387/770] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:25 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:25.519659 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-4eb97d1c-2ac7-4822-a28e-c8e428cd9fcc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:25.520210 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-4eb97d1c-2ac7-4822-a28e-c8e428cd9fcc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:25.526206 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-4eb97d1c-2ac7-4822-a28e-c8e428cd9fcc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:25.526655 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-4eb97d1c-2ac7-4822-a28e-c8e428cd9fcc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:25.527412 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-4eb97d1c-2ac7-4822-a28e-c8e428cd9fcc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:25.527850 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-4eb97d1c-2ac7-4822-a28e-c8e428cd9fcc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:25.545480 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:25.654647 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-4eb97d1c-2ac7-4822-a28e-c8e428cd9fcc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:25.662994 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-4eb97d1c-2ac7-4822-a28e-c8e428cd9fcc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:25.665295 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-4eb97d1c-2ac7-4822-a28e-c8e428cd9fcc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:25.666462 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-4eb97d1c-2ac7-4822-a28e-c8e428cd9fcc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1721 microversion: 2.20 time: 0.150745 Jul 05 16:14:25.667028 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 384/771] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:14:25 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:14:26.055936 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-75ed0f9e-852e-47c0-8cd5-aae9b6ef8a9c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:26.056558 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-75ed0f9e-852e-47c0-8cd5-aae9b6ef8a9c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:26.062757 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-75ed0f9e-852e-47c0-8cd5-aae9b6ef8a9c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:26.063226 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-75ed0f9e-852e-47c0-8cd5-aae9b6ef8a9c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:26.064003 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-75ed0f9e-852e-47c0-8cd5-aae9b6ef8a9c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:26.064441 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-75ed0f9e-852e-47c0-8cd5-aae9b6ef8a9c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:26.285939 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-ee554524-baf6-4b54-89eb-204bfe41f811 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:26.286552 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-ee554524-baf6-4b54-89eb-204bfe41f811 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:26.293332 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ee554524-baf6-4b54-89eb-204bfe41f811 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:26.293717 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ee554524-baf6-4b54-89eb-204bfe41f811 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:26.294639 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ee554524-baf6-4b54-89eb-204bfe41f811 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:26.294894 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ee554524-baf6-4b54-89eb-204bfe41f811 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:26.419349 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-75ed0f9e-852e-47c0-8cd5-aae9b6ef8a9c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:26.426776 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-75ed0f9e-852e-47c0-8cd5-aae9b6ef8a9c tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1521 microversion: 2.1 time: 0.375273 Jul 05 16:14:26.427351 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 388/772] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:26 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1521 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:26.637451 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-ee554524-baf6-4b54-89eb-204bfe41f811 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:26.645048 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-ee554524-baf6-4b54-89eb-204bfe41f811 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39" status: 200 len: 1366 microversion: 2.1 time: 0.362813 Jul 05 16:14:26.645611 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 385/773] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:26 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39 => generated 1366 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:14:26.684848 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-88e2c570-b018-4d7e-8880-9bc3ed54f127 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:26.685897 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-88e2c570-b018-4d7e-8880-9bc3ed54f127 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:26.691808 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-88e2c570-b018-4d7e-8880-9bc3ed54f127 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:26.692260 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-88e2c570-b018-4d7e-8880-9bc3ed54f127 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:26.693046 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-88e2c570-b018-4d7e-8880-9bc3ed54f127 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:26.693483 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-88e2c570-b018-4d7e-8880-9bc3ed54f127 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:26.926910 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell0:SELECT=2 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:26.947580 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-88e2c570-b018-4d7e-8880-9bc3ed54f127 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:26.956848 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-88e2c570-b018-4d7e-8880-9bc3ed54f127 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:26.958507 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-88e2c570-b018-4d7e-8880-9bc3ed54f127 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:26.959662 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-88e2c570-b018-4d7e-8880-9bc3ed54f127 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1721 microversion: 2.20 time: 0.278832 Jul 05 16:14:26.960801 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 389/774] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:14:26 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1721 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:14:27.148508 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [req-b63300bb-39fe-4072-8205-3d89a4d254e7 req-0d4965d3-9b31-496e-8e85-2c7e30f8d369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4233316e-f948-4729-a298-95bfa8d528da", "name": "network-vif-deleted", "tag": "0d3daec4-e5f2-405e-a531-5ab8f6778220"}]} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:14:27.156496 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-b63300bb-39fe-4072-8205-3d89a4d254e7 req-0d4965d3-9b31-496e-8e85-2c7e30f8d369 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:27.156969 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-b63300bb-39fe-4072-8205-3d89a4d254e7 req-0d4965d3-9b31-496e-8e85-2c7e30f8d369 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:27.169182 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.compute.server_external_events [req-b63300bb-39fe-4072-8205-3d89a4d254e7 req-0d4965d3-9b31-496e-8e85-2c7e30f8d369 service nova] Creating event network-vif-deleted:0d3daec4-e5f2-405e-a531-5ab8f6778220 for instance 4233316e-f948-4729-a298-95bfa8d528da on hv-cinder-84875 Jul 05 16:14:27.173934 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [req-b63300bb-39fe-4072-8205-3d89a4d254e7 req-0d4965d3-9b31-496e-8e85-2c7e30f8d369 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029950 Jul 05 16:14:27.174500 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 386/775] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:14:27.444667 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-77cca200-c3e9-4373-9ad2-2991f0a604d2 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:27.445394 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-77cca200-c3e9-4373-9ad2-2991f0a604d2 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:27.447908 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell0:SELECT=8 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:27.453121 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-77cca200-c3e9-4373-9ad2-2991f0a604d2 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:27.453579 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-77cca200-c3e9-4373-9ad2-2991f0a604d2 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:27.454361 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-77cca200-c3e9-4373-9ad2-2991f0a604d2 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:27.454802 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-77cca200-c3e9-4373-9ad2-2991f0a604d2 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:27.471152 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:27.525358 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-77cca200-c3e9-4373-9ad2-2991f0a604d2 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:27.533256 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-77cca200-c3e9-4373-9ad2-2991f0a604d2 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1479 microversion: 2.1 time: 0.092671 Jul 05 16:14:27.533855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 390/776] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:27 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1479 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:27.664033 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-9a969bf2-c5da-45d7-804a-cee41bdaab6e tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:27.665028 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-9a969bf2-c5da-45d7-804a-cee41bdaab6e tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:27.671872 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9a969bf2-c5da-45d7-804a-cee41bdaab6e tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:27.672359 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9a969bf2-c5da-45d7-804a-cee41bdaab6e tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:27.673152 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9a969bf2-c5da-45d7-804a-cee41bdaab6e tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:27.673598 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9a969bf2-c5da-45d7-804a-cee41bdaab6e tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:27.800189 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-9a969bf2-c5da-45d7-804a-cee41bdaab6e tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:27.807704 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-9a969bf2-c5da-45d7-804a-cee41bdaab6e tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39" status: 200 len: 1366 microversion: 2.1 time: 0.148509 Jul 05 16:14:27.808276 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 387/777] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:27 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:27.978877 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-ca81ba89-2307-4064-97d4-2705a1d1faac tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:27.979491 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-ca81ba89-2307-4064-97d4-2705a1d1faac tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:27.986282 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ca81ba89-2307-4064-97d4-2705a1d1faac tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:27.986865 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ca81ba89-2307-4064-97d4-2705a1d1faac tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:27.987588 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ca81ba89-2307-4064-97d4-2705a1d1faac tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:27.988029 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ca81ba89-2307-4064-97d4-2705a1d1faac tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:28.120373 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-ca81ba89-2307-4064-97d4-2705a1d1faac tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:28.128320 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-ca81ba89-2307-4064-97d4-2705a1d1faac tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:28.129864 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-ca81ba89-2307-4064-97d4-2705a1d1faac tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:28.131034 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-ca81ba89-2307-4064-97d4-2705a1d1faac tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1721 microversion: 2.20 time: 0.156630 Jul 05 16:14:28.131595 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 391/778] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:14:27 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:14:28.552203 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-2e36deed-c3ba-4739-a73d-8bacbee6994a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:28.552730 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-2e36deed-c3ba-4739-a73d-8bacbee6994a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:28.560204 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2e36deed-c3ba-4739-a73d-8bacbee6994a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:28.560657 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2e36deed-c3ba-4739-a73d-8bacbee6994a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:28.561438 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2e36deed-c3ba-4739-a73d-8bacbee6994a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:28.561876 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2e36deed-c3ba-4739-a73d-8bacbee6994a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:28.592962 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2e36deed-c3ba-4739-a73d-8bacbee6994a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:28.593409 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2e36deed-c3ba-4739-a73d-8bacbee6994a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:28.593847 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.objects.instance [None req-2e36deed-c3ba-4739-a73d-8bacbee6994a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lazy-loading 'fault' on Instance uuid 4233316e-f948-4729-a298-95bfa8d528da {{(pid=118319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 16:14:28.638312 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-2e36deed-c3ba-4739-a73d-8bacbee6994a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6e665914774eabba120e986e6bb282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe6a2de3cba4aa7b365f30f5b2f745c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:28.645731 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-2e36deed-c3ba-4739-a73d-8bacbee6994a tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 200 len: 1311 microversion: 2.1 time: 0.097734 Jul 05 16:14:28.646306 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 388/779] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:28 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:28.825562 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-6e546116-2527-4246-9e49-4083b0efc9af tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:28.826140 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-6e546116-2527-4246-9e49-4083b0efc9af tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:28.832795 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6e546116-2527-4246-9e49-4083b0efc9af tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:28.836967 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6e546116-2527-4246-9e49-4083b0efc9af tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:28.836967 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6e546116-2527-4246-9e49-4083b0efc9af tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:28.836967 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6e546116-2527-4246-9e49-4083b0efc9af tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:28.962966 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-6e546116-2527-4246-9e49-4083b0efc9af tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:28.970241 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-6e546116-2527-4246-9e49-4083b0efc9af tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39" status: 200 len: 1366 microversion: 2.1 time: 0.149080 Jul 05 16:14:28.970877 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 392/780] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:28 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:29.150513 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-87c76178-30c6-424f-ad21-37ab0c99ba0d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:29.151033 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-87c76178-30c6-424f-ad21-37ab0c99ba0d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:29.157795 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-87c76178-30c6-424f-ad21-37ab0c99ba0d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:29.158250 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-87c76178-30c6-424f-ad21-37ab0c99ba0d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:29.159017 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-87c76178-30c6-424f-ad21-37ab0c99ba0d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:29.159452 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-87c76178-30c6-424f-ad21-37ab0c99ba0d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:29.289007 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-87c76178-30c6-424f-ad21-37ab0c99ba0d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:29.297063 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-87c76178-30c6-424f-ad21-37ab0c99ba0d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:29.298559 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-87c76178-30c6-424f-ad21-37ab0c99ba0d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:29.299705 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-87c76178-30c6-424f-ad21-37ab0c99ba0d tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1721 microversion: 2.20 time: 0.153834 Jul 05 16:14:29.300266 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 389/781] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:14:29 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:14:29.663013 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-377968ac-35e1-4843-abdd-b41a52a63f35 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:29.663673 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-377968ac-35e1-4843-abdd-b41a52a63f35 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] [instance: 4233316e-f948-4729-a298-95bfa8d528da] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:29.670738 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-377968ac-35e1-4843-abdd-b41a52a63f35 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:29.671415 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-377968ac-35e1-4843-abdd-b41a52a63f35 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:29.672284 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-377968ac-35e1-4843-abdd-b41a52a63f35 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:29.672973 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-377968ac-35e1-4843-abdd-b41a52a63f35 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:29.685809 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-377968ac-35e1-4843-abdd-b41a52a63f35 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] HTTP exception thrown: Instance 4233316e-f948-4729-a298-95bfa8d528da could not be found. Jul 05 16:14:29.687456 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-377968ac-35e1-4843-abdd-b41a52a63f35 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Request method failure captured: Jul 05 16:14:29.687456 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da HTTP/1.1 Jul 05 16:14:29.687456 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:14:29.687456 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:14:29.687456 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:14:29.687456 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:14:29.687456 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:14:29.687456 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:14:29.687456 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:14:29.687456 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:14:29.687456 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIbm-fGDoYcXhi-DiBd_EHf54mABU16-lVoqKUsmzMxPfvtZz3cDR_eLFLAUXUkaoXiE_x_JaCy2K0M-p1S_UwLA--ZfDF_Efr5SkiXjg8KEFbKA2u7SIH1VdWaoghMLl3WnWI8g3GmnhK30BicBR2S2x7Pflc_2x-DFM7Iz5W2JHg Jul 05 16:14:29.687456 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:14:29.687456 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:14:29.687456 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:14:29.687456 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:14:29.687456 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:14:29.687456 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:14:29.687456 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: bbe6a2de3cba4aa7b365f30f5b2f745c Jul 05 16:14:29.687456 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1117569186 Jul 05 16:14:29.687456 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:14:29.687456 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:14:29.689091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bbe6a2de3cba4aa7b365f30f5b2f745c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bbe6a2de3cba4aa7b365f30f5b2f745c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bbe6a2de3cba4aa7b365f30f5b2f745c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bbe6a2de3cba4aa7b365f30f5b2f745c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:14:29.689091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1117569186 Jul 05 16:14:29.689091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: bbe6a2de3cba4aa7b365f30f5b2f745c Jul 05 16:14:29.689091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1117569186 Jul 05 16:14:29.689091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-ServerRescueNegativeTestJSON-1117569186-project Jul 05 16:14:29.689091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:14:29.689091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:14:29.689091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: 8b6e665914774eabba120e986e6bb282 Jul 05 16:14:29.689091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1117569186-project Jul 05 16:14:29.689091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:14:29.689091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance 4233316e-f948-4729-a298-95bfa8d528da could not be found. Jul 05 16:14:29.689091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': '4233316e-f948-4729-a298-95bfa8d528da'} Jul 05 16:14:29.690760 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:14:29.690760 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:14:29.690760 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:14:29.690760 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:14:29.690760 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:14:29.690760 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:14:29.690760 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:14:29.690760 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:14:29.690760 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:14:29.690760 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:14:29.690760 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4233316e-f948-4729-a298-95bfa8d528da could not be found. Jul 05 16:14:29.690760 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:29.690760 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:14:29.690760 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:29.690760 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:14:29.690760 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:14:29.690760 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:14:29.690760 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:14:29.690760 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:14:29.690760 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:14:29.692393 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:14:29.692393 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 16:14:29.692393 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 16:14:29.692393 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:14:29.692393 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:14:29.692393 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:14:29.692393 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:14:29.692393 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4233316e-f948-4729-a298-95bfa8d528da could not be found. Jul 05 16:14:29.692393 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:29.692393 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:14:29.692393 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:29.692393 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:14:29.692393 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:14:29.692393 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:14:29.692393 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:14:29.692393 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:14:29.692393 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4233316e-f948-4729-a298-95bfa8d528da could not be found. Jul 05 16:14:29.692393 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:29.695099 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-377968ac-35e1-4843-abdd-b41a52a63f35 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] Returning 404 to user: Instance 4233316e-f948-4729-a298-95bfa8d528da could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:14:29.695099 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-377968ac-35e1-4843-abdd-b41a52a63f35 tempest-ServerRescueNegativeTestJSON-1117569186 tempest-ServerRescueNegativeTestJSON-1117569186-project] 10.222.0.45 "GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da" status: 404 len: 111 microversion: 2.1 time: 0.029771 Jul 05 16:14:29.695099 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 393/782] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:29 2022] GET /compute/v2.1/servers/4233316e-f948-4729-a298-95bfa8d528da => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 16:14:29.987463 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-6ba2cab7-bbf8-4771-b2e6-2528c906b122 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:29.988122 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-6ba2cab7-bbf8-4771-b2e6-2528c906b122 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:29.996947 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-6ba2cab7-bbf8-4771-b2e6-2528c906b122 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:29.996947 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-6ba2cab7-bbf8-4771-b2e6-2528c906b122 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:29.997849 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-6ba2cab7-bbf8-4771-b2e6-2528c906b122 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:29.998457 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-6ba2cab7-bbf8-4771-b2e6-2528c906b122 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:30.146824 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-6ba2cab7-bbf8-4771-b2e6-2528c906b122 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:30.155267 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-6ba2cab7-bbf8-4771-b2e6-2528c906b122 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39" status: 200 len: 1366 microversion: 2.1 time: 0.172022 Jul 05 16:14:30.160916 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 390/783] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:29 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:30.318096 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-7bb2da20-661a-4aaa-a278-a22b6e9d704c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:30.318724 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-7bb2da20-661a-4aaa-a278-a22b6e9d704c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:30.325675 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7bb2da20-661a-4aaa-a278-a22b6e9d704c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:30.326129 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7bb2da20-661a-4aaa-a278-a22b6e9d704c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:30.326895 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7bb2da20-661a-4aaa-a278-a22b6e9d704c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:30.327334 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7bb2da20-661a-4aaa-a278-a22b6e9d704c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:30.457171 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-7bb2da20-661a-4aaa-a278-a22b6e9d704c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:30.466221 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-7bb2da20-661a-4aaa-a278-a22b6e9d704c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:30.467836 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-7bb2da20-661a-4aaa-a278-a22b6e9d704c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:30.469068 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-7bb2da20-661a-4aaa-a278-a22b6e9d704c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1721 microversion: 2.20 time: 0.154898 Jul 05 16:14:30.469637 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 394/784] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:14:30 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:14:31.171437 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-cd7d8e87-b77a-43ac-9bec-8b231e321368 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:31.172055 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-cd7d8e87-b77a-43ac-9bec-8b231e321368 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:31.178698 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cd7d8e87-b77a-43ac-9bec-8b231e321368 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:31.179153 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cd7d8e87-b77a-43ac-9bec-8b231e321368 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:31.179925 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cd7d8e87-b77a-43ac-9bec-8b231e321368 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:31.180365 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cd7d8e87-b77a-43ac-9bec-8b231e321368 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:31.315898 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-cd7d8e87-b77a-43ac-9bec-8b231e321368 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:31.323229 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-cd7d8e87-b77a-43ac-9bec-8b231e321368 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39" status: 200 len: 1366 microversion: 2.1 time: 0.155694 Jul 05 16:14:31.323803 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 391/785] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:31 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:31.487972 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-684a34dc-9fa7-4651-a4c2-0b06adc3c853 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:31.488561 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-684a34dc-9fa7-4651-a4c2-0b06adc3c853 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:31.496670 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-684a34dc-9fa7-4651-a4c2-0b06adc3c853 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:31.498450 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-684a34dc-9fa7-4651-a4c2-0b06adc3c853 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:31.499253 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-684a34dc-9fa7-4651-a4c2-0b06adc3c853 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:31.499699 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-684a34dc-9fa7-4651-a4c2-0b06adc3c853 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:31.634543 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-684a34dc-9fa7-4651-a4c2-0b06adc3c853 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:31.642818 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-684a34dc-9fa7-4651-a4c2-0b06adc3c853 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:31.644341 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-684a34dc-9fa7-4651-a4c2-0b06adc3c853 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:31.645532 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-684a34dc-9fa7-4651-a4c2-0b06adc3c853 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1742 microversion: 2.20 time: 0.161815 Jul 05 16:14:31.646088 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 395/786] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:14:31 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1742 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:14:32.224698 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [req-5a37a9b1-d0ad-4d66-a2bd-2c9b5fca1fd4 req-3fe409bf-b143-49fb-aa00-7807a3c69052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52a25436-864d-4302-9b41-f9f904dfaa39", "name": "network-vif-plugged", "status": "completed", "tag": "9ac8cbc0-45bd-47dc-8eb3-b69db5ea2a18"}]} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:14:32.233828 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-5a37a9b1-d0ad-4d66-a2bd-2c9b5fca1fd4 req-3fe409bf-b143-49fb-aa00-7807a3c69052 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:32.234421 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-5a37a9b1-d0ad-4d66-a2bd-2c9b5fca1fd4 req-3fe409bf-b143-49fb-aa00-7807a3c69052 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:32.246253 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.compute.server_external_events [req-5a37a9b1-d0ad-4d66-a2bd-2c9b5fca1fd4 req-3fe409bf-b143-49fb-aa00-7807a3c69052 service nova] Creating event network-vif-plugged:9ac8cbc0-45bd-47dc-8eb3-b69db5ea2a18 for instance 52a25436-864d-4302-9b41-f9f904dfaa39 on hv-cinder-84875 Jul 05 16:14:32.253571 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [req-5a37a9b1-d0ad-4d66-a2bd-2c9b5fca1fd4 req-3fe409bf-b143-49fb-aa00-7807a3c69052 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030309 Jul 05 16:14:32.253571 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 392/787] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:14:32.340002 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-d5e073a2-b67c-41de-9164-7a2bf54785d7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:32.340627 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-d5e073a2-b67c-41de-9164-7a2bf54785d7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:32.347319 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d5e073a2-b67c-41de-9164-7a2bf54785d7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:32.347957 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d5e073a2-b67c-41de-9164-7a2bf54785d7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:32.348751 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d5e073a2-b67c-41de-9164-7a2bf54785d7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:32.349427 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d5e073a2-b67c-41de-9164-7a2bf54785d7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:32.518704 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-d5e073a2-b67c-41de-9164-7a2bf54785d7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:32.526880 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-d5e073a2-b67c-41de-9164-7a2bf54785d7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39" status: 200 len: 1366 microversion: 2.1 time: 0.190829 Jul 05 16:14:32.527385 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 396/788] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:32 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:14:32.668525 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-141e7b1c-b49a-4fe8-b221-13f725a2800c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:32.669504 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-141e7b1c-b49a-4fe8-b221-13f725a2800c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:32.675948 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-141e7b1c-b49a-4fe8-b221-13f725a2800c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:32.676615 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-141e7b1c-b49a-4fe8-b221-13f725a2800c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:32.677584 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-141e7b1c-b49a-4fe8-b221-13f725a2800c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:32.678127 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-141e7b1c-b49a-4fe8-b221-13f725a2800c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:32.810058 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-141e7b1c-b49a-4fe8-b221-13f725a2800c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:32.818168 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-141e7b1c-b49a-4fe8-b221-13f725a2800c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:32.819703 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-141e7b1c-b49a-4fe8-b221-13f725a2800c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:32.820901 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-141e7b1c-b49a-4fe8-b221-13f725a2800c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1742 microversion: 2.20 time: 0.156636 Jul 05 16:14:32.821460 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 393/789] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:14:32 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:14:33.544238 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-3f8d1ec5-9e59-4012-a2d8-eca983c0c4e6 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:33.544816 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-3f8d1ec5-9e59-4012-a2d8-eca983c0c4e6 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:33.551365 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3f8d1ec5-9e59-4012-a2d8-eca983c0c4e6 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:33.551820 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3f8d1ec5-9e59-4012-a2d8-eca983c0c4e6 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:33.552584 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3f8d1ec5-9e59-4012-a2d8-eca983c0c4e6 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:33.553053 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3f8d1ec5-9e59-4012-a2d8-eca983c0c4e6 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:33.683088 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-3f8d1ec5-9e59-4012-a2d8-eca983c0c4e6 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:33.690564 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-3f8d1ec5-9e59-4012-a2d8-eca983c0c4e6 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39" status: 200 len: 1366 microversion: 2.1 time: 0.150339 Jul 05 16:14:33.691427 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 397/790] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:33 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:33.839167 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-cf0a09c5-847a-4bf9-8e80-f9100c8bc4b9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:33.839804 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-cf0a09c5-847a-4bf9-8e80-f9100c8bc4b9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:33.846705 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cf0a09c5-847a-4bf9-8e80-f9100c8bc4b9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:33.847150 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cf0a09c5-847a-4bf9-8e80-f9100c8bc4b9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:33.848049 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cf0a09c5-847a-4bf9-8e80-f9100c8bc4b9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:33.848488 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cf0a09c5-847a-4bf9-8e80-f9100c8bc4b9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:34.007750 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-cf0a09c5-847a-4bf9-8e80-f9100c8bc4b9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:34.025319 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-cf0a09c5-847a-4bf9-8e80-f9100c8bc4b9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:34.026811 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-cf0a09c5-847a-4bf9-8e80-f9100c8bc4b9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:34.033694 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-cf0a09c5-847a-4bf9-8e80-f9100c8bc4b9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1737 microversion: 2.20 time: 0.198357 Jul 05 16:14:34.034289 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 394/791] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:14:33 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1737 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:14:34.266457 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-3d48526a-3b19-42bc-ba6c-d8c81c1fd916 req-1b1e4b8d-71fd-4acf-bf97-7bb1a2cc4bba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33b7b310-f555-460e-a187-4940bb9df69a", "name": "network-vif-plugged", "status": "completed", "tag": "1ad3c6ce-99b9-4f8a-bbe2-1636e320f9ff"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:14:34.274750 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-3d48526a-3b19-42bc-ba6c-d8c81c1fd916 req-1b1e4b8d-71fd-4acf-bf97-7bb1a2cc4bba service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:34.275193 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-3d48526a-3b19-42bc-ba6c-d8c81c1fd916 req-1b1e4b8d-71fd-4acf-bf97-7bb1a2cc4bba service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:34.286007 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-3d48526a-3b19-42bc-ba6c-d8c81c1fd916 req-1b1e4b8d-71fd-4acf-bf97-7bb1a2cc4bba service nova] Creating event network-vif-plugged:1ad3c6ce-99b9-4f8a-bbe2-1636e320f9ff for instance 33b7b310-f555-460e-a187-4940bb9df69a on hv-cinder-84875 Jul 05 16:14:34.291052 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-3d48526a-3b19-42bc-ba6c-d8c81c1fd916 req-1b1e4b8d-71fd-4acf-bf97-7bb1a2cc4bba service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028337 Jul 05 16:14:34.291634 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 398/792] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:14:34.707584 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-5247809d-3525-4037-b213-7eb95c5d3273 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:34.708204 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-5247809d-3525-4037-b213-7eb95c5d3273 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:34.714901 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-5247809d-3525-4037-b213-7eb95c5d3273 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:34.715354 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-5247809d-3525-4037-b213-7eb95c5d3273 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:34.716127 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-5247809d-3525-4037-b213-7eb95c5d3273 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:34.716565 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-5247809d-3525-4037-b213-7eb95c5d3273 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:34.859966 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-5247809d-3525-4037-b213-7eb95c5d3273 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:34.868381 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-5247809d-3525-4037-b213-7eb95c5d3273 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39" status: 200 len: 1556 microversion: 2.1 time: 0.164864 Jul 05 16:14:34.868978 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 395/793] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:34 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39 => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:34.891002 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-76be5db0-68a4-48e7-b707-f9c12d17fcf6 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:34.891485 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-76be5db0-68a4-48e7-b707-f9c12d17fcf6 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:34.897791 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-76be5db0-68a4-48e7-b707-f9c12d17fcf6 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:34.898267 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-76be5db0-68a4-48e7-b707-f9c12d17fcf6 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:34.899024 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-76be5db0-68a4-48e7-b707-f9c12d17fcf6 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:34.899454 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-76be5db0-68a4-48e7-b707-f9c12d17fcf6 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:34.978611 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-76be5db0-68a4-48e7-b707-f9c12d17fcf6 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092430 Jul 05 16:14:34.979296 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 399/794] 10.222.0.45 () {58 vars in 1274 bytes} [Tue Jul 5 16:14:34 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:14:35.052870 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-cd375cf8-5720-40fe-b71e-8a1dafa9d78c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:35.053944 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-cd375cf8-5720-40fe-b71e-8a1dafa9d78c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:35.059931 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cd375cf8-5720-40fe-b71e-8a1dafa9d78c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:35.060438 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cd375cf8-5720-40fe-b71e-8a1dafa9d78c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:35.061241 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cd375cf8-5720-40fe-b71e-8a1dafa9d78c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:35.061680 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-cd375cf8-5720-40fe-b71e-8a1dafa9d78c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:35.287025 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-cd375cf8-5720-40fe-b71e-8a1dafa9d78c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:35.305915 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-cd375cf8-5720-40fe-b71e-8a1dafa9d78c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:35.307437 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-cd375cf8-5720-40fe-b71e-8a1dafa9d78c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:35.312615 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-cd375cf8-5720-40fe-b71e-8a1dafa9d78c tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1737 microversion: 2.20 time: 0.259726 Jul 05 16:14:35.312615 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 396/795] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:14:35 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1737 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:14:36.327312 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-b52d0bf0-f091-4572-8711-a757f4ada5f8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:36.328689 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-b52d0bf0-f091-4572-8711-a757f4ada5f8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:36.335763 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b52d0bf0-f091-4572-8711-a757f4ada5f8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:36.336422 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b52d0bf0-f091-4572-8711-a757f4ada5f8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:36.337391 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b52d0bf0-f091-4572-8711-a757f4ada5f8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:36.337830 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b52d0bf0-f091-4572-8711-a757f4ada5f8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:36.639529 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-b52d0bf0-f091-4572-8711-a757f4ada5f8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:36.651678 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-b52d0bf0-f091-4572-8711-a757f4ada5f8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:36.656084 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-b52d0bf0-f091-4572-8711-a757f4ada5f8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:36.657991 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-b52d0bf0-f091-4572-8711-a757f4ada5f8 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1737 microversion: 2.20 time: 0.334593 Jul 05 16:14:36.660822 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 400/796] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:14:36 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1737 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:14:36.809041 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [req-eae2a85b-c902-4ca2-b94b-9c44c290f476 req-78f52d8f-294e-4c9e-854b-67f8ed23c222 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52a25436-864d-4302-9b41-f9f904dfaa39", "tag": "9ac8cbc0-45bd-47dc-8eb3-b69db5ea2a18"}]} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:14:36.818218 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-eae2a85b-c902-4ca2-b94b-9c44c290f476 req-78f52d8f-294e-4c9e-854b-67f8ed23c222 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:36.819485 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-eae2a85b-c902-4ca2-b94b-9c44c290f476 req-78f52d8f-294e-4c9e-854b-67f8ed23c222 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:36.834067 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.compute.server_external_events [req-eae2a85b-c902-4ca2-b94b-9c44c290f476 req-78f52d8f-294e-4c9e-854b-67f8ed23c222 service nova] Creating event network-changed:9ac8cbc0-45bd-47dc-8eb3-b69db5ea2a18 for instance 52a25436-864d-4302-9b41-f9f904dfaa39 on hv-cinder-84875 Jul 05 16:14:36.841448 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [req-eae2a85b-c902-4ca2-b94b-9c44c290f476 req-78f52d8f-294e-4c9e-854b-67f8ed23c222 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.203965 Jul 05 16:14:36.842672 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 397/797] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:14:37.681681 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-7fce1956-67a8-4053-a01f-3f59237ab957 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:37.682348 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-7fce1956-67a8-4053-a01f-3f59237ab957 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:37.689220 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7fce1956-67a8-4053-a01f-3f59237ab957 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:37.689932 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7fce1956-67a8-4053-a01f-3f59237ab957 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:37.690875 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7fce1956-67a8-4053-a01f-3f59237ab957 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:37.691478 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7fce1956-67a8-4053-a01f-3f59237ab957 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:37.853646 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-7fce1956-67a8-4053-a01f-3f59237ab957 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:37.868039 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-7fce1956-67a8-4053-a01f-3f59237ab957 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:37.870011 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-7fce1956-67a8-4053-a01f-3f59237ab957 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:37.871372 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-7fce1956-67a8-4053-a01f-3f59237ab957 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1737 microversion: 2.20 time: 0.195819 Jul 05 16:14:37.872440 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 401/798] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:14:37 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1737 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:14:38.891431 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-403d693a-9213-4f99-b22a-018b23bac942 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:38.892123 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-403d693a-9213-4f99-b22a-018b23bac942 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:38.899659 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-403d693a-9213-4f99-b22a-018b23bac942 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:38.900119 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-403d693a-9213-4f99-b22a-018b23bac942 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:38.900922 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-403d693a-9213-4f99-b22a-018b23bac942 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:38.901374 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-403d693a-9213-4f99-b22a-018b23bac942 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:39.071529 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-403d693a-9213-4f99-b22a-018b23bac942 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:39.082192 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-403d693a-9213-4f99-b22a-018b23bac942 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:39.083981 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-403d693a-9213-4f99-b22a-018b23bac942 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:39.085691 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-403d693a-9213-4f99-b22a-018b23bac942 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1737 microversion: 2.20 time: 0.199115 Jul 05 16:14:39.086652 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 398/799] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:14:38 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1737 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:14:40.106737 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-9457adc2-60ec-4672-9ecb-838c7c911d9a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:40.111448 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-9457adc2-60ec-4672-9ecb-838c7c911d9a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:40.122251 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9457adc2-60ec-4672-9ecb-838c7c911d9a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:40.122991 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9457adc2-60ec-4672-9ecb-838c7c911d9a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:40.123941 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9457adc2-60ec-4672-9ecb-838c7c911d9a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:40.124379 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9457adc2-60ec-4672-9ecb-838c7c911d9a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:40.296876 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-9457adc2-60ec-4672-9ecb-838c7c911d9a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:40.309429 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-9457adc2-60ec-4672-9ecb-838c7c911d9a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:40.310961 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-9457adc2-60ec-4672-9ecb-838c7c911d9a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:40.313354 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-9457adc2-60ec-4672-9ecb-838c7c911d9a tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1737 microversion: 2.20 time: 0.210818 Jul 05 16:14:40.324669 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 402/800] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:14:40 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:14:41.332151 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-dcbfff3f-0093-4eab-8182-1b759430a431 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:41.332756 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-dcbfff3f-0093-4eab-8182-1b759430a431 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:41.339244 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-dcbfff3f-0093-4eab-8182-1b759430a431 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:41.339813 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-dcbfff3f-0093-4eab-8182-1b759430a431 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:41.340693 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-dcbfff3f-0093-4eab-8182-1b759430a431 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:41.341262 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-dcbfff3f-0093-4eab-8182-1b759430a431 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:41.508713 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-dcbfff3f-0093-4eab-8182-1b759430a431 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:41.518609 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-dcbfff3f-0093-4eab-8182-1b759430a431 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:41.520994 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-dcbfff3f-0093-4eab-8182-1b759430a431 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:41.523191 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-dcbfff3f-0093-4eab-8182-1b759430a431 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1737 microversion: 2.20 time: 0.195562 Jul 05 16:14:41.524346 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 399/801] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:14:41 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1737 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:14:42.548415 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-42bab5d2-fe46-4454-b2f0-9dd4b9607097 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:42.548415 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-42bab5d2-fe46-4454-b2f0-9dd4b9607097 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:42.552190 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:42.564219 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-42bab5d2-fe46-4454-b2f0-9dd4b9607097 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:42.565797 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-42bab5d2-fe46-4454-b2f0-9dd4b9607097 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:42.566769 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-42bab5d2-fe46-4454-b2f0-9dd4b9607097 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:42.567399 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-42bab5d2-fe46-4454-b2f0-9dd4b9607097 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:42.812238 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-42bab5d2-fe46-4454-b2f0-9dd4b9607097 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:42.822082 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-42bab5d2-fe46-4454-b2f0-9dd4b9607097 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:42.826011 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-42bab5d2-fe46-4454-b2f0-9dd4b9607097 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:42.827714 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-42bab5d2-fe46-4454-b2f0-9dd4b9607097 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1737 microversion: 2.20 time: 0.289152 Jul 05 16:14:42.828882 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 403/802] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:14:42 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1737 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:14:43.848592 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-5a637721-e14f-48b9-8866-f522ac584104 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:43.849242 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-5a637721-e14f-48b9-8866-f522ac584104 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:43.858991 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-5a637721-e14f-48b9-8866-f522ac584104 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:43.862048 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-5a637721-e14f-48b9-8866-f522ac584104 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:43.862048 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-5a637721-e14f-48b9-8866-f522ac584104 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:43.862048 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-5a637721-e14f-48b9-8866-f522ac584104 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:44.033489 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-5a637721-e14f-48b9-8866-f522ac584104 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:44.049077 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-5a637721-e14f-48b9-8866-f522ac584104 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:44.051017 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-5a637721-e14f-48b9-8866-f522ac584104 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:44.052314 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-5a637721-e14f-48b9-8866-f522ac584104 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1737 microversion: 2.20 time: 0.209668 Jul 05 16:14:44.052973 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 400/803] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:14:43 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:14:44.086465 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-540b6ae8-8018-4986-84fe-44a0c9767ded tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-485465084"}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:14:44.087623 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-540b6ae8-8018-4986-84fe-44a0c9767ded tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:44.095171 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-540b6ae8-8018-4986-84fe-44a0c9767ded tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:44.096071 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-540b6ae8-8018-4986-84fe-44a0c9767ded tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:44.097896 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-540b6ae8-8018-4986-84fe-44a0c9767ded tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:44.098688 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-540b6ae8-8018-4986-84fe-44a0c9767ded tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:44.269203 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.network.security_group_api [None req-540b6ae8-8018-4986-84fe-44a0c9767ded tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Removing security group 193810cf-2e17-46e2-b6c3-5ef68e3c5435 from port 0acdc586-b1e0-458b-8b41-006c61e42c40 Jul 05 16:14:44.779183 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-540b6ae8-8018-4986-84fe-44a0c9767ded tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "POST /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7/action" status: 202 len: 0 microversion: 2.1 time: 0.698082 Jul 05 16:14:44.780002 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 404/804] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Jul 5 16:14:44 2022] POST /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7/action => generated 0 bytes in 700 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 16:14:44.797630 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [req-81c16930-b8aa-40f6-b919-66ba245e700e req-f7fd8da2-b474-480f-b9fa-34b9f0ed065c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7e85e1f-39bb-4c8c-addb-85ae261a3eb7", "tag": "0acdc586-b1e0-458b-8b41-006c61e42c40"}]} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:14:44.806602 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-81c16930-b8aa-40f6-b919-66ba245e700e req-f7fd8da2-b474-480f-b9fa-34b9f0ed065c service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:44.807457 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-81c16930-b8aa-40f6-b919-66ba245e700e req-f7fd8da2-b474-480f-b9fa-34b9f0ed065c service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:44.829835 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.compute.server_external_events [req-81c16930-b8aa-40f6-b919-66ba245e700e req-f7fd8da2-b474-480f-b9fa-34b9f0ed065c service nova] Creating event network-changed:0acdc586-b1e0-458b-8b41-006c61e42c40 for instance e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 on hv-cinder-84875 Jul 05 16:14:44.920231 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [req-81c16930-b8aa-40f6-b919-66ba245e700e req-f7fd8da2-b474-480f-b9fa-34b9f0ed065c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128683 Jul 05 16:14:44.921899 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 401/805] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:14:45.081717 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-2319d420-48c5-4692-a24c-e53594066898 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:45.082533 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-2319d420-48c5-4692-a24c-e53594066898 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:45.092153 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2319d420-48c5-4692-a24c-e53594066898 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:45.093405 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2319d420-48c5-4692-a24c-e53594066898 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:45.094212 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2319d420-48c5-4692-a24c-e53594066898 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:45.094758 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2319d420-48c5-4692-a24c-e53594066898 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:45.353454 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-2319d420-48c5-4692-a24c-e53594066898 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:45.361774 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-2319d420-48c5-4692-a24c-e53594066898 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:45.363303 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-2319d420-48c5-4692-a24c-e53594066898 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:45.364473 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-2319d420-48c5-4692-a24c-e53594066898 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1737 microversion: 2.20 time: 0.290062 Jul 05 16:14:45.366237 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 405/806] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:14:45 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1737 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:14:46.385503 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-182abc35-e0ff-4d6f-bfb6-a1c5083f2823 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:46.386266 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-182abc35-e0ff-4d6f-bfb6-a1c5083f2823 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:46.393346 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-182abc35-e0ff-4d6f-bfb6-a1c5083f2823 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:46.393836 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-182abc35-e0ff-4d6f-bfb6-a1c5083f2823 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:46.394725 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-182abc35-e0ff-4d6f-bfb6-a1c5083f2823 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:46.395171 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-182abc35-e0ff-4d6f-bfb6-a1c5083f2823 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:46.549123 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-182abc35-e0ff-4d6f-bfb6-a1c5083f2823 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:46.557370 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-182abc35-e0ff-4d6f-bfb6-a1c5083f2823 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:46.559099 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-182abc35-e0ff-4d6f-bfb6-a1c5083f2823 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:46.560314 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-182abc35-e0ff-4d6f-bfb6-a1c5083f2823 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1737 microversion: 2.20 time: 0.180610 Jul 05 16:14:46.560892 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 402/807] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:14:46 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1737 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:14:46.761041 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-87de771b-d58b-4b21-b0f0-7a5d971c7c10 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:46.761747 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-87de771b-d58b-4b21-b0f0-7a5d971c7c10 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:46.768630 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-87de771b-d58b-4b21-b0f0-7a5d971c7c10 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:46.771581 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-87de771b-d58b-4b21-b0f0-7a5d971c7c10 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:46.771581 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-87de771b-d58b-4b21-b0f0-7a5d971c7c10 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:46.771581 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-87de771b-d58b-4b21-b0f0-7a5d971c7c10 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:46.877073 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.objects.instance [None req-87de771b-d58b-4b21-b0f0-7a5d971c7c10 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lazy-loading 'services' on Instance uuid e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 {{(pid=118320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 16:14:46.962720 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [req-721b211e-a27b-4b0b-bdd5-58f2e99aef0c req-081b2133-01aa-40b9-a91e-70f4d9642883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7e85e1f-39bb-4c8c-addb-85ae261a3eb7", "tag": "0acdc586-b1e0-458b-8b41-006c61e42c40"}]} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:14:46.970517 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-721b211e-a27b-4b0b-bdd5-58f2e99aef0c req-081b2133-01aa-40b9-a91e-70f4d9642883 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:46.971013 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-721b211e-a27b-4b0b-bdd5-58f2e99aef0c req-081b2133-01aa-40b9-a91e-70f4d9642883 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:46.982883 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.compute.server_external_events [req-721b211e-a27b-4b0b-bdd5-58f2e99aef0c req-081b2133-01aa-40b9-a91e-70f4d9642883 service nova] Creating event network-changed:0acdc586-b1e0-458b-8b41-006c61e42c40 for instance e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 on hv-cinder-84875 Jul 05 16:14:46.988193 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [req-721b211e-a27b-4b0b-bdd5-58f2e99aef0c req-081b2133-01aa-40b9-a91e-70f4d9642883 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.220036 Jul 05 16:14:46.988824 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 403/808] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:14:47.127508 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-87de771b-d58b-4b21-b0f0-7a5d971c7c10 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7/os-volume_attachments/1d66407f-7df2-4581-b340-6d204a4d21d6" status: 202 len: 0 microversion: 2.1 time: 0.371483 Jul 05 16:14:47.128117 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 406/809] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Jul 5 16:14:46 2022] DELETE /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7/os-volume_attachments/1d66407f-7df2-4581-b340-6d204a4d21d6 => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 16:14:47.137020 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-0f0935b5-5a2b-4dc4-a0bd-be6a3c8add13 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:47.138301 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-0f0935b5-5a2b-4dc4-a0bd-be6a3c8add13 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:47.144894 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0f0935b5-5a2b-4dc4-a0bd-be6a3c8add13 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:47.145474 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0f0935b5-5a2b-4dc4-a0bd-be6a3c8add13 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:47.146347 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0f0935b5-5a2b-4dc4-a0bd-be6a3c8add13 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:47.147650 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0f0935b5-5a2b-4dc4-a0bd-be6a3c8add13 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:47.151862 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell1:SELECT=100 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:47.178723 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-0f0935b5-5a2b-4dc4-a0bd-be6a3c8add13 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045406 Jul 05 16:14:47.179579 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 404/810] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Jul 5 16:14:47 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:14:47.580053 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-5ce95c18-6a83-4ca6-a696-39d015045b53 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:47.580859 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-5ce95c18-6a83-4ca6-a696-39d015045b53 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:47.588454 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5ce95c18-6a83-4ca6-a696-39d015045b53 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:47.588943 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5ce95c18-6a83-4ca6-a696-39d015045b53 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:47.589748 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5ce95c18-6a83-4ca6-a696-39d015045b53 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:47.590177 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5ce95c18-6a83-4ca6-a696-39d015045b53 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:47.732353 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-5ce95c18-6a83-4ca6-a696-39d015045b53 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:47.741147 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-5ce95c18-6a83-4ca6-a696-39d015045b53 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:47.742695 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-5ce95c18-6a83-4ca6-a696-39d015045b53 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:47.743862 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-5ce95c18-6a83-4ca6-a696-39d015045b53 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1719 microversion: 2.20 time: 0.168615 Jul 05 16:14:47.744441 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 407/811] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:14:47 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:14:48.191643 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-390624bb-4fee-4a90-b5d1-fa2892a27db9 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:48.193444 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-390624bb-4fee-4a90-b5d1-fa2892a27db9 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:48.196110 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:48.201392 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-390624bb-4fee-4a90-b5d1-fa2892a27db9 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:48.201845 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-390624bb-4fee-4a90-b5d1-fa2892a27db9 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:48.202684 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-390624bb-4fee-4a90-b5d1-fa2892a27db9 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:48.203115 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-390624bb-4fee-4a90-b5d1-fa2892a27db9 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:48.237177 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-390624bb-4fee-4a90-b5d1-fa2892a27db9 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049627 Jul 05 16:14:48.237781 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 405/812] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Jul 5 16:14:48 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:14:48.765575 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-646a7cb0-7a83-4899-a74d-1c7306f921e5 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:48.766216 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-646a7cb0-7a83-4899-a74d-1c7306f921e5 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:48.773516 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-646a7cb0-7a83-4899-a74d-1c7306f921e5 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:48.774024 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-646a7cb0-7a83-4899-a74d-1c7306f921e5 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:48.774805 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-646a7cb0-7a83-4899-a74d-1c7306f921e5 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:48.775257 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-646a7cb0-7a83-4899-a74d-1c7306f921e5 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:48.790356 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:48.909377 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-646a7cb0-7a83-4899-a74d-1c7306f921e5 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:48.917341 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-646a7cb0-7a83-4899-a74d-1c7306f921e5 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:48.918891 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-646a7cb0-7a83-4899-a74d-1c7306f921e5 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:48.920082 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-646a7cb0-7a83-4899-a74d-1c7306f921e5 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1719 microversion: 2.20 time: 0.158896 Jul 05 16:14:48.920648 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 408/813] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:14:48 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:14:49.249883 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-1b2f639c-356a-423f-923d-22653972685b tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:49.250809 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-1b2f639c-356a-423f-923d-22653972685b tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:49.257436 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1b2f639c-356a-423f-923d-22653972685b tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:49.257895 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1b2f639c-356a-423f-923d-22653972685b tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:49.258662 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1b2f639c-356a-423f-923d-22653972685b tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:49.259100 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1b2f639c-356a-423f-923d-22653972685b tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:49.286928 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-1b2f639c-356a-423f-923d-22653972685b tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041363 Jul 05 16:14:49.288104 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 406/814] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Jul 5 16:14:49 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 16:14:49.297925 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-b8b1a9f5-b286-445c-bac1-9f0077c2bddb tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:49.298418 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-b8b1a9f5-b286-445c-bac1-9f0077c2bddb tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:49.304815 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b8b1a9f5-b286-445c-bac1-9f0077c2bddb tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:49.305266 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b8b1a9f5-b286-445c-bac1-9f0077c2bddb tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:49.306016 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b8b1a9f5-b286-445c-bac1-9f0077c2bddb tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:49.306444 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b8b1a9f5-b286-445c-bac1-9f0077c2bddb tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:49.379157 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-b8b1a9f5-b286-445c-bac1-9f0077c2bddb tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] HTTP exception thrown: Instance e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 is not attached to volume 1d66407f-7df2-4581-b340-6d204a4d21d6 Jul 05 16:14:49.382057 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-b8b1a9f5-b286-445c-bac1-9f0077c2bddb tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Request method failure captured: Jul 05 16:14:49.382057 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: DELETE /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7/os-volume_attachments/1d66407f-7df2-4581-b340-6d204a4d21d6 HTTP/1.1 Jul 05 16:14:49.382057 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:14:49.382057 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:14:49.382057 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:14:49.382057 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:14:49.382057 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:14:49.382057 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:14:49.382057 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:14:49.382057 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:14:49.382057 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGLa7t4DhS-ohJI8lIpznu-hHr7VFk_b7klpVyz3n6UGQQ4Uf6zurJphDNk4ckLy1jLPUtrU9d4D3TM4tL5jroIywbjpH6qrcUb2tyHHg7hlCOO-xZs2HEqGPFP7De785nKCdentj_PfYGBI-hpezqFFMZJnOYtfZhwwIgPr7noGi3A Jul 05 16:14:49.382057 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:14:49.382057 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:14:49.382057 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:14:49.382057 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:14:49.382057 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:14:49.382057 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:14:49.382057 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 71b68c04578747d08842aab556e98030 Jul 05 16:14:49.382057 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-TestMinimumBasicScenario-825647622 Jul 05 16:14:49.382057 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:14:49.382057 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:14:49.383657 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_71b68c04578747d08842aab556e98030"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/71b68c04578747d08842aab556e98030"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/71b68c04578747d08842aab556e98030"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/71b68c04578747d08842aab556e98030"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:14:49.383657 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-TestMinimumBasicScenario-825647622 Jul 05 16:14:49.383657 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 71b68c04578747d08842aab556e98030 Jul 05 16:14:49.383657 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-TestMinimumBasicScenario-825647622 Jul 05 16:14:49.383657 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-TestMinimumBasicScenario-825647622-project Jul 05 16:14:49.383657 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:14:49.383657 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:14:49.383657 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: 80de40d2a02343858849d481590aa570 Jul 05 16:14:49.383657 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-TestMinimumBasicScenario-825647622-project Jul 05 16:14:49.383657 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:14:49.383657 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 is not attached to volume 1d66407f-7df2-4581-b340-6d204a4d21d6 Jul 05 16:14:49.384511 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'server_id': 'e7e85e1f-39bb-4c8c-addb-85ae261a3eb7', 'id': '1d66407f-7df2-4581-b340-6d204a4d21d6'} Jul 05 16:14:49.384511 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:14:49.384511 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:14:49.384511 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 05 16:14:49.384511 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 05 16:14:49.384511 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 05 16:14:49.384511 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 05 16:14:49.384511 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 05 16:14:49.384511 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 05 16:14:49.384511 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1d66407f-7df2-4581-b340-6d204a4d21d6. Jul 05 16:14:49.384511 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:49.384511 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:14:49.384511 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:49.384511 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:14:49.384511 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:14:49.384511 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:14:49.384511 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:14:49.384511 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:14:49.384511 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:14:49.386002 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:14:49.386002 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 05 16:14:49.386002 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 05 16:14:49.386002 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 is not attached to volume 1d66407f-7df2-4581-b340-6d204a4d21d6 Jul 05 16:14:49.386002 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:49.386002 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:14:49.386002 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:49.386002 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:14:49.386002 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:14:49.386002 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:14:49.386002 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:14:49.386002 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:14:49.386002 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 is not attached to volume 1d66407f-7df2-4581-b340-6d204a4d21d6 Jul 05 16:14:49.386002 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:49.386002 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-b8b1a9f5-b286-445c-bac1-9f0077c2bddb tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Returning 404 to user: Instance e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 is not attached to volume 1d66407f-7df2-4581-b340-6d204a4d21d6 {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:14:49.387141 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-b8b1a9f5-b286-445c-bac1-9f0077c2bddb tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7/os-volume_attachments/1d66407f-7df2-4581-b340-6d204a4d21d6" status: 404 len: 154 microversion: 2.1 time: 0.089559 Jul 05 16:14:49.387439 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 409/815] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Jul 5 16:14:49 2022] DELETE /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7/os-volume_attachments/1d66407f-7df2-4581-b340-6d204a4d21d6 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 16:14:49.938085 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-2646b545-5e9a-4407-9859-dc4fdd570a60 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:49.938695 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-2646b545-5e9a-4407-9859-dc4fdd570a60 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:49.945374 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2646b545-5e9a-4407-9859-dc4fdd570a60 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:49.951911 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2646b545-5e9a-4407-9859-dc4fdd570a60 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:49.951911 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2646b545-5e9a-4407-9859-dc4fdd570a60 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:49.951911 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2646b545-5e9a-4407-9859-dc4fdd570a60 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:50.086235 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-2646b545-5e9a-4407-9859-dc4fdd570a60 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:50.094240 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-2646b545-5e9a-4407-9859-dc4fdd570a60 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:50.095756 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-2646b545-5e9a-4407-9859-dc4fdd570a60 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:50.096959 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-2646b545-5e9a-4407-9859-dc4fdd570a60 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1719 microversion: 2.20 time: 0.162717 Jul 05 16:14:50.097525 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 407/816] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:14:49 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:14:50.139695 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-ce2c4b6a-2994-4359-9403-fd4b2655ceff req-82ef9d26-6404-45d0-9484-b34689eb9f40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33b7b310-f555-460e-a187-4940bb9df69a", "name": "network-vif-unplugged", "status": "completed", "tag": "1ad3c6ce-99b9-4f8a-bbe2-1636e320f9ff"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:14:50.149246 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-ce2c4b6a-2994-4359-9403-fd4b2655ceff req-82ef9d26-6404-45d0-9484-b34689eb9f40 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:50.149685 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-ce2c4b6a-2994-4359-9403-fd4b2655ceff req-82ef9d26-6404-45d0-9484-b34689eb9f40 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:50.160857 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-ce2c4b6a-2994-4359-9403-fd4b2655ceff req-82ef9d26-6404-45d0-9484-b34689eb9f40 service nova] Creating event network-vif-unplugged:1ad3c6ce-99b9-4f8a-bbe2-1636e320f9ff for instance 33b7b310-f555-460e-a187-4940bb9df69a on hv-cinder-84875 Jul 05 16:14:50.166940 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-ce2c4b6a-2994-4359-9403-fd4b2655ceff req-82ef9d26-6404-45d0-9484-b34689eb9f40 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096086 Jul 05 16:14:50.167556 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 410/817] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:14:50.701842 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-0b5df70e-d79a-427c-8ad6-6a4ece8a03d4 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:50.701842 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-0b5df70e-d79a-427c-8ad6-6a4ece8a03d4 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:50.707456 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0b5df70e-d79a-427c-8ad6-6a4ece8a03d4 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:50.707912 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0b5df70e-d79a-427c-8ad6-6a4ece8a03d4 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:50.708677 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0b5df70e-d79a-427c-8ad6-6a4ece8a03d4 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:50.709773 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0b5df70e-d79a-427c-8ad6-6a4ece8a03d4 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:50.733676 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-0b5df70e-d79a-427c-8ad6-6a4ece8a03d4 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Going to try to terminate instance {{(pid=118319) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 16:14:51.110783 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-0b5df70e-d79a-427c-8ad6-6a4ece8a03d4 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 204 len: 0 microversion: 2.1 time: 0.413785 Jul 05 16:14:51.111303 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 408/818] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Jul 5 16:14:50 2022] DELETE /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 16:14:51.118787 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-0d2278af-2e25-4857-934c-fa69dfa64263 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:51.119498 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-0d2278af-2e25-4857-934c-fa69dfa64263 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:51.119762 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-1cd92689-9541-4cc4-8817-04c357b145b7 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:51.120499 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-1cd92689-9541-4cc4-8817-04c357b145b7 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:51.125924 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0d2278af-2e25-4857-934c-fa69dfa64263 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:51.126352 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1cd92689-9541-4cc4-8817-04c357b145b7 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:51.126474 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0d2278af-2e25-4857-934c-fa69dfa64263 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:51.126844 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1cd92689-9541-4cc4-8817-04c357b145b7 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:51.127248 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0d2278af-2e25-4857-934c-fa69dfa64263 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:51.127621 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1cd92689-9541-4cc4-8817-04c357b145b7 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:51.127724 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0d2278af-2e25-4857-934c-fa69dfa64263 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:51.128060 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1cd92689-9541-4cc4-8817-04c357b145b7 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:51.325778 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-1cd92689-9541-4cc4-8817-04c357b145b7 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:51.328401 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-0d2278af-2e25-4857-934c-fa69dfa64263 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:51.333110 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-1cd92689-9541-4cc4-8817-04c357b145b7 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1556 microversion: 2.1 time: 0.217374 Jul 05 16:14:51.333768 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 409/819] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:51 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1556 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:14:51.336496 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-0d2278af-2e25-4857-934c-fa69dfa64263 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:51.338046 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-0d2278af-2e25-4857-934c-fa69dfa64263 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:51.339243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-0d2278af-2e25-4857-934c-fa69dfa64263 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1722 microversion: 2.20 time: 0.225274 Jul 05 16:14:51.339978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 411/820] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:14:51 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:14:51.357206 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-48799e72-732b-41b9-8d1f-478f2f64f6c5 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63a1fcd6-c540-42c6-8552-3e791353e44f"}} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:14:51.358317 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-48799e72-732b-41b9-8d1f-478f2f64f6c5 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:51.364743 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-48799e72-732b-41b9-8d1f-478f2f64f6c5 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:51.365787 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-48799e72-732b-41b9-8d1f-478f2f64f6c5 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:51.366546 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-48799e72-732b-41b9-8d1f-478f2f64f6c5 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:51.366982 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-48799e72-732b-41b9-8d1f-478f2f64f6c5 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:52.338465 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-48799e72-732b-41b9-8d1f-478f2f64f6c5 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "POST /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.985142 Jul 05 16:14:52.339237 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 410/821] 10.222.0.45 () {62 vars in 1363 bytes} [Tue Jul 5 16:14:51 2022] POST /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a/os-volume_attachments => generated 188 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 16:14:52.350933 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-115c6698-cd6a-424a-b495-30470c077f2e tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:52.351633 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-115c6698-cd6a-424a-b495-30470c077f2e tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:52.358105 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-115c6698-cd6a-424a-b495-30470c077f2e tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:52.358568 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-115c6698-cd6a-424a-b495-30470c077f2e tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:52.361781 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-115c6698-cd6a-424a-b495-30470c077f2e tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:52.361781 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-115c6698-cd6a-424a-b495-30470c077f2e tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:52.459792 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-3e0d1544-00b1-4a32-9999-5094d0e3c4af tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:52.460290 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-3e0d1544-00b1-4a32-9999-5094d0e3c4af tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:52.466608 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3e0d1544-00b1-4a32-9999-5094d0e3c4af tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:52.467059 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3e0d1544-00b1-4a32-9999-5094d0e3c4af tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:52.467825 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3e0d1544-00b1-4a32-9999-5094d0e3c4af tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:52.468258 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-3e0d1544-00b1-4a32-9999-5094d0e3c4af tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:52.493102 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-115c6698-cd6a-424a-b495-30470c077f2e tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:52.501088 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-115c6698-cd6a-424a-b495-30470c077f2e tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1556 microversion: 2.1 time: 0.154726 Jul 05 16:14:52.501652 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 412/822] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:52 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:53.057936 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-3e0d1544-00b1-4a32-9999-5094d0e3c4af tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "DELETE /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a/os-volume_attachments/63a1fcd6-c540-42c6-8552-3e791353e44f" status: 202 len: 0 microversion: 2.20 time: 0.602253 Jul 05 16:14:53.058741 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 411/823] 10.222.0.45 () {60 vars in 1456 bytes} [Tue Jul 5 16:14:52 2022] DELETE /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a/os-volume_attachments/63a1fcd6-c540-42c6-8552-3e791353e44f => generated 0 bytes in 604 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 05 16:14:53.116166 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-a0683887-ddf3-4e81-8a86-6955f102cd51 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:14:53.116728 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-a0683887-ddf3-4e81-8a86-6955f102cd51 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:53.122654 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a0683887-ddf3-4e81-8a86-6955f102cd51 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:53.123102 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a0683887-ddf3-4e81-8a86-6955f102cd51 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:53.123860 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a0683887-ddf3-4e81-8a86-6955f102cd51 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:53.124293 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a0683887-ddf3-4e81-8a86-6955f102cd51 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:53.322589 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-a0683887-ddf3-4e81-8a86-6955f102cd51 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "POST /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a/action" status: 202 len: 0 microversion: 2.20 time: 0.210330 Jul 05 16:14:53.331659 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-f3bfb3d3-88c5-4b4e-aea3-49e416146d9e tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:53.332275 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-f3bfb3d3-88c5-4b4e-aea3-49e416146d9e tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:53.334377 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 413/824] 10.222.0.45 () {62 vars in 1318 bytes} [Tue Jul 5 16:14:53 2022] POST /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 05 16:14:53.339243 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f3bfb3d3-88c5-4b4e-aea3-49e416146d9e tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:53.339694 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f3bfb3d3-88c5-4b4e-aea3-49e416146d9e tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:53.340663 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f3bfb3d3-88c5-4b4e-aea3-49e416146d9e tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:53.341131 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-f3bfb3d3-88c5-4b4e-aea3-49e416146d9e tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:53.464237 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-b7001036-13d2-48ea-81c7-65ec12baf5f9 req-9468e573-d073-46c1-89c0-c4f92eb8c3e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7e85e1f-39bb-4c8c-addb-85ae261a3eb7", "name": "network-vif-deleted", "tag": "0acdc586-b1e0-458b-8b41-006c61e42c40"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:14:53.473491 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-b7001036-13d2-48ea-81c7-65ec12baf5f9 req-9468e573-d073-46c1-89c0-c4f92eb8c3e9 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:53.475395 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-b7001036-13d2-48ea-81c7-65ec12baf5f9 req-9468e573-d073-46c1-89c0-c4f92eb8c3e9 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:53.487267 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-b7001036-13d2-48ea-81c7-65ec12baf5f9 req-9468e573-d073-46c1-89c0-c4f92eb8c3e9 service nova] Creating event network-vif-deleted:0acdc586-b1e0-458b-8b41-006c61e42c40 for instance e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 on hv-cinder-84875 Jul 05 16:14:53.493133 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-b7001036-13d2-48ea-81c7-65ec12baf5f9 req-9468e573-d073-46c1-89c0-c4f92eb8c3e9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033337 Jul 05 16:14:53.494053 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 414/825] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:14:53.520538 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-8d815e7a-a89d-4d18-9a7c-b7afa3e194a5 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:53.521612 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-8d815e7a-a89d-4d18-9a7c-b7afa3e194a5 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:53.528519 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8d815e7a-a89d-4d18-9a7c-b7afa3e194a5 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:53.529148 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8d815e7a-a89d-4d18-9a7c-b7afa3e194a5 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:53.530134 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8d815e7a-a89d-4d18-9a7c-b7afa3e194a5 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:53.530755 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8d815e7a-a89d-4d18-9a7c-b7afa3e194a5 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:53.541544 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-f3bfb3d3-88c5-4b4e-aea3-49e416146d9e tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:53.551385 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-f3bfb3d3-88c5-4b4e-aea3-49e416146d9e tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:53.553627 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-f3bfb3d3-88c5-4b4e-aea3-49e416146d9e tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:53.555136 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-f3bfb3d3-88c5-4b4e-aea3-49e416146d9e tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1670 microversion: 2.20 time: 0.227684 Jul 05 16:14:53.555707 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 412/826] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:14:53 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1670 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:14:53.596359 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-8d815e7a-a89d-4d18-9a7c-b7afa3e194a5 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de40d2a02343858849d481590aa570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b68c04578747d08842aab556e98030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:53.606555 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-8d815e7a-a89d-4d18-9a7c-b7afa3e194a5 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 200 len: 1514 microversion: 2.1 time: 0.090396 Jul 05 16:14:53.607269 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 415/827] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:53 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 1514 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:14:54.576952 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-1507e983-e1e0-4153-a359-73d1571453bc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:54.577901 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-1507e983-e1e0-4153-a359-73d1571453bc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:54.588402 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1507e983-e1e0-4153-a359-73d1571453bc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:54.589653 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1507e983-e1e0-4153-a359-73d1571453bc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:54.590403 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1507e983-e1e0-4153-a359-73d1571453bc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:54.591086 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1507e983-e1e0-4153-a359-73d1571453bc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:54.627527 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-d7f0f372-9167-454b-819f-9e2b0ce615ef tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:54.628308 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-d7f0f372-9167-454b-819f-9e2b0ce615ef tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] [instance: e7e85e1f-39bb-4c8c-addb-85ae261a3eb7] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:54.635823 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d7f0f372-9167-454b-819f-9e2b0ce615ef tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:54.636569 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d7f0f372-9167-454b-819f-9e2b0ce615ef tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:54.637432 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d7f0f372-9167-454b-819f-9e2b0ce615ef tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:54.638194 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d7f0f372-9167-454b-819f-9e2b0ce615ef tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:54.658404 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-d7f0f372-9167-454b-819f-9e2b0ce615ef tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] HTTP exception thrown: Instance e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 could not be found. Jul 05 16:14:54.660217 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-d7f0f372-9167-454b-819f-9e2b0ce615ef tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Request method failure captured: Jul 05 16:14:54.660217 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 HTTP/1.1 Jul 05 16:14:54.660217 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:14:54.660217 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:14:54.660217 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:14:54.660217 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:14:54.660217 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:14:54.660217 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:14:54.660217 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:14:54.660217 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:14:54.660217 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGLa7t4DhS-ohJI8lIpznu-hHr7VFk_b7klpVyz3n6UGQQ4Uf6zurJphDNk4ckLy1jLPUtrU9d4D3TM4tL5jroIywbjpH6qrcUb2tyHHg7hlCOO-xZs2HEqGPFP7De785nKCdentj_PfYGBI-hpezqFFMZJnOYtfZhwwIgPr7noGi3A Jul 05 16:14:54.660217 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:14:54.660217 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:14:54.660217 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:14:54.660217 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:14:54.660217 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:14:54.660217 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:14:54.660217 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 71b68c04578747d08842aab556e98030 Jul 05 16:14:54.660217 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-TestMinimumBasicScenario-825647622 Jul 05 16:14:54.660217 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:14:54.660217 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:14:54.661796 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_71b68c04578747d08842aab556e98030"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/71b68c04578747d08842aab556e98030"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/71b68c04578747d08842aab556e98030"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/71b68c04578747d08842aab556e98030"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:14:54.661796 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-TestMinimumBasicScenario-825647622 Jul 05 16:14:54.661796 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 71b68c04578747d08842aab556e98030 Jul 05 16:14:54.661796 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-TestMinimumBasicScenario-825647622 Jul 05 16:14:54.661796 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-TestMinimumBasicScenario-825647622-project Jul 05 16:14:54.661796 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:14:54.661796 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:14:54.661796 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: 80de40d2a02343858849d481590aa570 Jul 05 16:14:54.661796 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-TestMinimumBasicScenario-825647622-project Jul 05 16:14:54.661796 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:14:54.661796 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 could not be found. Jul 05 16:14:54.661796 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': 'e7e85e1f-39bb-4c8c-addb-85ae261a3eb7'} Jul 05 16:14:54.663628 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:14:54.663628 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:14:54.663628 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:14:54.663628 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:14:54.663628 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:14:54.663628 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:14:54.663628 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:14:54.663628 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:14:54.663628 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:14:54.663628 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:14:54.663628 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 could not be found. Jul 05 16:14:54.663628 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:54.663628 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:14:54.663628 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:54.663628 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:14:54.663628 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:14:54.663628 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:14:54.663628 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:14:54.663628 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:14:54.663628 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:14:54.665115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:14:54.665115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 16:14:54.665115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 16:14:54.665115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:14:54.665115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:14:54.665115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:14:54.665115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:14:54.665115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 could not be found. Jul 05 16:14:54.665115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:54.665115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:14:54.665115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:54.665115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:14:54.665115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:14:54.665115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:14:54.665115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:14:54.665115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:14:54.665115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 could not be found. Jul 05 16:14:54.665115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:14:54.667462 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-d7f0f372-9167-454b-819f-9e2b0ce615ef tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Returning 404 to user: Instance e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:14:54.668549 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-d7f0f372-9167-454b-819f-9e2b0ce615ef tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7" status: 404 len: 111 microversion: 2.1 time: 0.044932 Jul 05 16:14:54.669436 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 416/828] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:14:54 2022] GET /compute/v2.1/servers/e7e85e1f-39bb-4c8c-addb-85ae261a3eb7 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 16:14:54.677575 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-0b720ff7-e6c0-475e-a101-97ad57659293 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] Calling method '.version_select at 0x7f3087c08430>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:54.748543 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-1507e983-e1e0-4153-a359-73d1571453bc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:54.757149 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-1507e983-e1e0-4153-a359-73d1571453bc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:54.758734 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-1507e983-e1e0-4153-a359-73d1571453bc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:54.759966 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-1507e983-e1e0-4153-a359-73d1571453bc tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1670 microversion: 2.20 time: 0.189196 Jul 05 16:14:54.760533 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 413/829] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:14:54 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1670 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:14:54.810394 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-0b720ff7-e6c0-475e-a101-97ad57659293 tempest-TestMinimumBasicScenario-825647622 tempest-TestMinimumBasicScenario-825647622-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1872870087" status: 202 len: 0 microversion: 2.1 time: 0.134941 Jul 05 16:14:54.811274 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 417/830] 10.222.0.45 () {58 vars in 1271 bytes} [Tue Jul 5 16:14:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1872870087 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 16:14:55.778434 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-caabcc78-bacb-430b-813c-b41a597b47ea tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:55.779088 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-caabcc78-bacb-430b-813c-b41a597b47ea tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:55.787563 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-caabcc78-bacb-430b-813c-b41a597b47ea tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:55.787563 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-caabcc78-bacb-430b-813c-b41a597b47ea tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:55.788015 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-caabcc78-bacb-430b-813c-b41a597b47ea tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:55.788205 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-caabcc78-bacb-430b-813c-b41a597b47ea tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:55.791549 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=9,nova_cell1:INSERT=6 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:14:55.977061 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-caabcc78-bacb-430b-813c-b41a597b47ea tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:55.985137 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-caabcc78-bacb-430b-813c-b41a597b47ea tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:55.986653 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-caabcc78-bacb-430b-813c-b41a597b47ea tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:55.987884 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-caabcc78-bacb-430b-813c-b41a597b47ea tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1728 microversion: 2.20 time: 0.213415 Jul 05 16:14:55.988485 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 414/831] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:14:55 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1728 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:14:57.008887 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-fa713709-f71f-4d65-bfe5-65d1edc38393 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:57.009514 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-fa713709-f71f-4d65-bfe5-65d1edc38393 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:57.020243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fa713709-f71f-4d65-bfe5-65d1edc38393 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:57.020992 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fa713709-f71f-4d65-bfe5-65d1edc38393 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:57.027870 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fa713709-f71f-4d65-bfe5-65d1edc38393 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:57.028603 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fa713709-f71f-4d65-bfe5-65d1edc38393 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:57.302569 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-fa713709-f71f-4d65-bfe5-65d1edc38393 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:57.321451 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-fa713709-f71f-4d65-bfe5-65d1edc38393 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:57.324612 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-fa713709-f71f-4d65-bfe5-65d1edc38393 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:57.327245 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-fa713709-f71f-4d65-bfe5-65d1edc38393 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1728 microversion: 2.20 time: 0.321824 Jul 05 16:14:57.327467 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 418/832] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:14:57 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1728 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:14:58.347031 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-aae0677f-bcd1-470e-b6e7-42700367d29b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:58.348680 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-aae0677f-bcd1-470e-b6e7-42700367d29b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:58.362764 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-aae0677f-bcd1-470e-b6e7-42700367d29b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:58.369442 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-aae0677f-bcd1-470e-b6e7-42700367d29b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:58.370510 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-aae0677f-bcd1-470e-b6e7-42700367d29b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:58.371136 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-aae0677f-bcd1-470e-b6e7-42700367d29b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:58.618443 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-aae0677f-bcd1-470e-b6e7-42700367d29b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:58.642099 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-aae0677f-bcd1-470e-b6e7-42700367d29b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:58.651896 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-aae0677f-bcd1-470e-b6e7-42700367d29b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:58.657891 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-aae0677f-bcd1-470e-b6e7-42700367d29b tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1728 microversion: 2.20 time: 0.311950 Jul 05 16:14:58.658628 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 415/833] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:14:58 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1728 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:14:59.678316 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-683b8c77-5b94-4b2d-ac93-6a490e66cde9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:14:59.679079 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-683b8c77-5b94-4b2d-ac93-6a490e66cde9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:14:59.699314 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-683b8c77-5b94-4b2d-ac93-6a490e66cde9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:59.701824 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-683b8c77-5b94-4b2d-ac93-6a490e66cde9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:59.703686 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-683b8c77-5b94-4b2d-ac93-6a490e66cde9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:14:59.713024 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-683b8c77-5b94-4b2d-ac93-6a490e66cde9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:14:59.890828 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-683b8c77-5b94-4b2d-ac93-6a490e66cde9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:59.899622 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-683b8c77-5b94-4b2d-ac93-6a490e66cde9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:59.901165 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-683b8c77-5b94-4b2d-ac93-6a490e66cde9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:14:59.902345 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-683b8c77-5b94-4b2d-ac93-6a490e66cde9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1728 microversion: 2.20 time: 0.228528 Jul 05 16:14:59.914788 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 419/834] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:14:59 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1728 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:15:00.470953 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-8f3f54a9-731c-443e-9c6a-fab0d6a45c89 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:00.471811 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-8f3f54a9-731c-443e-9c6a-fab0d6a45c89 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:00.491329 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8f3f54a9-731c-443e-9c6a-fab0d6a45c89 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:00.491792 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8f3f54a9-731c-443e-9c6a-fab0d6a45c89 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:00.492588 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8f3f54a9-731c-443e-9c6a-fab0d6a45c89 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:00.493064 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8f3f54a9-731c-443e-9c6a-fab0d6a45c89 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:00.530119 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-8f3f54a9-731c-443e-9c6a-fab0d6a45c89 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66/ips" status: 200 len: 145 microversion: 2.1 time: 0.264643 Jul 05 16:15:00.539461 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 416/835] 10.222.0.45 () {58 vars in 1247 bytes} [Tue Jul 5 16:15:00 2022] GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66/ips => generated 145 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:15:00.922102 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-5df06607-b2de-4616-a5f4-baf0317d06a1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:00.923316 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-5df06607-b2de-4616-a5f4-baf0317d06a1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:00.930740 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5df06607-b2de-4616-a5f4-baf0317d06a1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:00.931247 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5df06607-b2de-4616-a5f4-baf0317d06a1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:00.932242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5df06607-b2de-4616-a5f4-baf0317d06a1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:00.933006 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5df06607-b2de-4616-a5f4-baf0317d06a1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:01.275351 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-5df06607-b2de-4616-a5f4-baf0317d06a1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:01.284247 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-5df06607-b2de-4616-a5f4-baf0317d06a1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:01.295488 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-5df06607-b2de-4616-a5f4-baf0317d06a1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:01.296805 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-5df06607-b2de-4616-a5f4-baf0317d06a1 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1728 microversion: 2.20 time: 0.379648 Jul 05 16:15:01.301557 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 420/836] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:15:00 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1728 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:15:02.320937 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-7bca4917-3b8a-4f41-a793-f3275866e4f7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:02.322193 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-7bca4917-3b8a-4f41-a793-f3275866e4f7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:02.328651 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7bca4917-3b8a-4f41-a793-f3275866e4f7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:02.329341 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7bca4917-3b8a-4f41-a793-f3275866e4f7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:02.330323 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7bca4917-3b8a-4f41-a793-f3275866e4f7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:02.330917 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7bca4917-3b8a-4f41-a793-f3275866e4f7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:02.473463 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-7dc33ec6-6312-4bf7-95d2-845797aaf807 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f600fe9-87d2-4d23-90bd-81e757f43aed"}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:15:02.486665 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-7dc33ec6-6312-4bf7-95d2-845797aaf807 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:02.498764 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7dc33ec6-6312-4bf7-95d2-845797aaf807 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:02.499457 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7dc33ec6-6312-4bf7-95d2-845797aaf807 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:02.501157 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7dc33ec6-6312-4bf7-95d2-845797aaf807 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:02.501675 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7dc33ec6-6312-4bf7-95d2-845797aaf807 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:02.558178 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-7bca4917-3b8a-4f41-a793-f3275866e4f7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:02.566659 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-7bca4917-3b8a-4f41-a793-f3275866e4f7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:02.568951 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-7bca4917-3b8a-4f41-a793-f3275866e4f7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:02.570360 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-7bca4917-3b8a-4f41-a793-f3275866e4f7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1728 microversion: 2.20 time: 0.254730 Jul 05 16:15:02.580883 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 417/837] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:15:02 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1728 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:15:03.589102 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-df9d3950-c872-4cec-8c98-824a3ebd4cbd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:03.589692 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-df9d3950-c872-4cec-8c98-824a3ebd4cbd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:03.601717 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-df9d3950-c872-4cec-8c98-824a3ebd4cbd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:03.602577 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-df9d3950-c872-4cec-8c98-824a3ebd4cbd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:03.603629 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-df9d3950-c872-4cec-8c98-824a3ebd4cbd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:03.604229 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-df9d3950-c872-4cec-8c98-824a3ebd4cbd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:03.953681 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-df9d3950-c872-4cec-8c98-824a3ebd4cbd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:03.968073 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-df9d3950-c872-4cec-8c98-824a3ebd4cbd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:03.973027 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-df9d3950-c872-4cec-8c98-824a3ebd4cbd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:03.976493 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-df9d3950-c872-4cec-8c98-824a3ebd4cbd tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1728 microversion: 2.20 time: 0.391056 Jul 05 16:15:03.988283 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 418/838] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:15:03 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1728 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:15:04.995871 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-9276433f-fbf8-4cf8-bc8e-263fcb902c30 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:04.997891 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-9276433f-fbf8-4cf8-bc8e-263fcb902c30 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:05.003319 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9276433f-fbf8-4cf8-bc8e-263fcb902c30 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:05.003891 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9276433f-fbf8-4cf8-bc8e-263fcb902c30 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:05.004671 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9276433f-fbf8-4cf8-bc8e-263fcb902c30 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:05.005131 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-9276433f-fbf8-4cf8-bc8e-263fcb902c30 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:05.366211 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-9276433f-fbf8-4cf8-bc8e-263fcb902c30 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:05.373926 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-9276433f-fbf8-4cf8-bc8e-263fcb902c30 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:05.375414 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-9276433f-fbf8-4cf8-bc8e-263fcb902c30 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:05.376608 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-9276433f-fbf8-4cf8-bc8e-263fcb902c30 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1728 microversion: 2.20 time: 0.384988 Jul 05 16:15:05.377199 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 419/839] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:15:04 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1728 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:15:06.394445 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-a3216ce6-e4a1-4430-ab16-3e84aa17c796 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:06.396459 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-a3216ce6-e4a1-4430-ab16-3e84aa17c796 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:06.401427 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a3216ce6-e4a1-4430-ab16-3e84aa17c796 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:06.401868 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a3216ce6-e4a1-4430-ab16-3e84aa17c796 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:06.402647 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a3216ce6-e4a1-4430-ab16-3e84aa17c796 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:06.403079 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a3216ce6-e4a1-4430-ab16-3e84aa17c796 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:06.541830 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-a3216ce6-e4a1-4430-ab16-3e84aa17c796 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:06.550226 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-a3216ce6-e4a1-4430-ab16-3e84aa17c796 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:06.551769 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-a3216ce6-e4a1-4430-ab16-3e84aa17c796 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:06.553064 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-a3216ce6-e4a1-4430-ab16-3e84aa17c796 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1728 microversion: 2.20 time: 0.162412 Jul 05 16:15:06.553638 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 420/840] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:15:06 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:15:07.148099 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-7dc33ec6-6312-4bf7-95d2-845797aaf807 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "POST /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.680369 Jul 05 16:15:07.148708 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 421/841] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Jul 5 16:15:02 2022] POST /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66/os-volume_attachments => generated 194 bytes in 4682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:15:07.571263 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-5a89aca0-6007-403e-836a-b42ed95ae181 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:07.571882 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-5a89aca0-6007-403e-836a-b42ed95ae181 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:07.578459 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-5a89aca0-6007-403e-836a-b42ed95ae181 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:07.578819 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-5a89aca0-6007-403e-836a-b42ed95ae181 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:07.579605 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-5a89aca0-6007-403e-836a-b42ed95ae181 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:07.580013 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-5a89aca0-6007-403e-836a-b42ed95ae181 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:07.713524 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-5a89aca0-6007-403e-836a-b42ed95ae181 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:07.722299 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-5a89aca0-6007-403e-836a-b42ed95ae181 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:07.724352 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-5a89aca0-6007-403e-836a-b42ed95ae181 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:07.725889 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-5a89aca0-6007-403e-836a-b42ed95ae181 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1728 microversion: 2.20 time: 0.159435 Jul 05 16:15:07.726800 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 421/842] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:15:07 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:15:08.745554 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-4302f9cf-3c08-42d3-8132-fe2702549db9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:08.746499 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-4302f9cf-3c08-42d3-8132-fe2702549db9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:08.754900 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4302f9cf-3c08-42d3-8132-fe2702549db9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:08.755463 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4302f9cf-3c08-42d3-8132-fe2702549db9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:08.756255 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4302f9cf-3c08-42d3-8132-fe2702549db9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:08.756701 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4302f9cf-3c08-42d3-8132-fe2702549db9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:08.886697 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-4302f9cf-3c08-42d3-8132-fe2702549db9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:08.894845 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-4302f9cf-3c08-42d3-8132-fe2702549db9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:08.896954 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-4302f9cf-3c08-42d3-8132-fe2702549db9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:08.898120 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-4302f9cf-3c08-42d3-8132-fe2702549db9 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1728 microversion: 2.20 time: 0.157276 Jul 05 16:15:08.898683 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 422/843] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:15:08 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:15:09.919496 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-e4922ab3-c8b5-4cf9-b9c3-c167bb1eb5bf tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:09.923947 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-e4922ab3-c8b5-4cf9-b9c3-c167bb1eb5bf tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:09.926218 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e4922ab3-c8b5-4cf9-b9c3-c167bb1eb5bf tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:09.926670 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e4922ab3-c8b5-4cf9-b9c3-c167bb1eb5bf tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:09.928026 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e4922ab3-c8b5-4cf9-b9c3-c167bb1eb5bf tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:09.928462 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-e4922ab3-c8b5-4cf9-b9c3-c167bb1eb5bf tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:10.069957 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-e4922ab3-c8b5-4cf9-b9c3-c167bb1eb5bf tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:10.078481 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-e4922ab3-c8b5-4cf9-b9c3-c167bb1eb5bf tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:10.080008 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-e4922ab3-c8b5-4cf9-b9c3-c167bb1eb5bf tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:10.081263 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-e4922ab3-c8b5-4cf9-b9c3-c167bb1eb5bf tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1728 microversion: 2.20 time: 0.169085 Jul 05 16:15:10.082013 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 422/844] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:15:09 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:15:10.157557 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-1dec8681-0845-4605-8054-2d6434347f34 req-021b926b-1c02-4c25-a3b3-fac79e46269a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33b7b310-f555-460e-a187-4940bb9df69a", "name": "network-vif-plugged", "status": "completed", "tag": "1ad3c6ce-99b9-4f8a-bbe2-1636e320f9ff"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:15:10.166525 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-1dec8681-0845-4605-8054-2d6434347f34 req-021b926b-1c02-4c25-a3b3-fac79e46269a service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:10.166971 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-1dec8681-0845-4605-8054-2d6434347f34 req-021b926b-1c02-4c25-a3b3-fac79e46269a service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:10.178283 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-1dec8681-0845-4605-8054-2d6434347f34 req-021b926b-1c02-4c25-a3b3-fac79e46269a service nova] Creating event network-vif-plugged:1ad3c6ce-99b9-4f8a-bbe2-1636e320f9ff for instance 33b7b310-f555-460e-a187-4940bb9df69a on hv-cinder-84875 Jul 05 16:15:10.183293 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-1dec8681-0845-4605-8054-2d6434347f34 req-021b926b-1c02-4c25-a3b3-fac79e46269a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029435 Jul 05 16:15:10.183891 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 423/845] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:15:11.104303 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-d9d8e8c4-0ab1-4eaf-9f29-8751345dbe39 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:11.107778 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-d9d8e8c4-0ab1-4eaf-9f29-8751345dbe39 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:11.112741 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d9d8e8c4-0ab1-4eaf-9f29-8751345dbe39 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:11.113259 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d9d8e8c4-0ab1-4eaf-9f29-8751345dbe39 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:11.114036 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d9d8e8c4-0ab1-4eaf-9f29-8751345dbe39 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:11.114470 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-d9d8e8c4-0ab1-4eaf-9f29-8751345dbe39 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:11.252042 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-d9d8e8c4-0ab1-4eaf-9f29-8751345dbe39 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:11.260033 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-d9d8e8c4-0ab1-4eaf-9f29-8751345dbe39 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:11.261570 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-d9d8e8c4-0ab1-4eaf-9f29-8751345dbe39 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:11.264160 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-d9d8e8c4-0ab1-4eaf-9f29-8751345dbe39 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1728 microversion: 2.20 time: 0.162601 Jul 05 16:15:11.264160 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 423/846] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:15:11 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:15:12.283012 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-84e3a8fa-0fe6-419a-9ef4-7cc1128b5538 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:12.283708 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-84e3a8fa-0fe6-419a-9ef4-7cc1128b5538 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:12.297827 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-84e3a8fa-0fe6-419a-9ef4-7cc1128b5538 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:12.298280 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-84e3a8fa-0fe6-419a-9ef4-7cc1128b5538 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:12.299051 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-84e3a8fa-0fe6-419a-9ef4-7cc1128b5538 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:12.299488 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-84e3a8fa-0fe6-419a-9ef4-7cc1128b5538 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:12.433561 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-84e3a8fa-0fe6-419a-9ef4-7cc1128b5538 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:12.442032 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-84e3a8fa-0fe6-419a-9ef4-7cc1128b5538 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:12.444259 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-84e3a8fa-0fe6-419a-9ef4-7cc1128b5538 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:12.445500 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-84e3a8fa-0fe6-419a-9ef4-7cc1128b5538 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1728 microversion: 2.20 time: 0.167119 Jul 05 16:15:12.446070 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 424/847] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:15:12 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:15:13.463065 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-0b8c5276-4f6d-480e-aa55-5e9ad7c9af60 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:13.464264 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-0b8c5276-4f6d-480e-aa55-5e9ad7c9af60 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:13.470921 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0b8c5276-4f6d-480e-aa55-5e9ad7c9af60 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:13.471372 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0b8c5276-4f6d-480e-aa55-5e9ad7c9af60 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:13.472322 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0b8c5276-4f6d-480e-aa55-5e9ad7c9af60 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:13.472778 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-0b8c5276-4f6d-480e-aa55-5e9ad7c9af60 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:13.613929 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-0b8c5276-4f6d-480e-aa55-5e9ad7c9af60 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:13.621982 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-0b8c5276-4f6d-480e-aa55-5e9ad7c9af60 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:13.623477 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-0b8c5276-4f6d-480e-aa55-5e9ad7c9af60 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:13.624656 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-0b8c5276-4f6d-480e-aa55-5e9ad7c9af60 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1728 microversion: 2.20 time: 0.165575 Jul 05 16:15:13.625237 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 424/848] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:15:13 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:15:14.568119 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-d2da3b12-9e7a-4453-8513-2ce229d7ffb3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:14.568883 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-d2da3b12-9e7a-4453-8513-2ce229d7ffb3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:14.571147 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:15:14.575848 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d2da3b12-9e7a-4453-8513-2ce229d7ffb3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:14.576295 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d2da3b12-9e7a-4453-8513-2ce229d7ffb3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:14.577090 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d2da3b12-9e7a-4453-8513-2ce229d7ffb3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:14.577524 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d2da3b12-9e7a-4453-8513-2ce229d7ffb3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:14.603639 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-d2da3b12-9e7a-4453-8513-2ce229d7ffb3 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39/ips" status: 200 len: 149 microversion: 2.1 time: 0.039338 Jul 05 16:15:14.609493 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 425/849] 10.222.0.45 () {58 vars in 1247 bytes} [Tue Jul 5 16:15:14 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:15:14.643474 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-6db9e04c-b55e-4e52-856c-4a43197a4299 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:14.646135 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-6db9e04c-b55e-4e52-856c-4a43197a4299 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:14.667196 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-6db9e04c-b55e-4e52-856c-4a43197a4299 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:14.667882 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-6db9e04c-b55e-4e52-856c-4a43197a4299 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:14.669235 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-6db9e04c-b55e-4e52-856c-4a43197a4299 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:14.670139 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-6db9e04c-b55e-4e52-856c-4a43197a4299 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:14.737078 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-1c936972-4741-48ee-a26e-dd1c5cad43b0 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:14.738315 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-1c936972-4741-48ee-a26e-dd1c5cad43b0 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:14.745396 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1c936972-4741-48ee-a26e-dd1c5cad43b0 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:14.746104 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1c936972-4741-48ee-a26e-dd1c5cad43b0 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:14.751404 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1c936972-4741-48ee-a26e-dd1c5cad43b0 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:14.751404 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1c936972-4741-48ee-a26e-dd1c5cad43b0 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:14.776061 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:15:14.781236 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-1c936972-4741-48ee-a26e-dd1c5cad43b0 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049569 Jul 05 16:15:14.781921 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 426/850] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Jul 5 16:15:14 2022] GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:15:14.791443 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-22012103-adb3-494a-8577-633d3956e2d6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:14.791947 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-22012103-adb3-494a-8577-633d3956e2d6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:14.799034 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-22012103-adb3-494a-8577-633d3956e2d6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:14.803420 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-22012103-adb3-494a-8577-633d3956e2d6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:14.803420 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-22012103-adb3-494a-8577-633d3956e2d6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:14.803420 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-22012103-adb3-494a-8577-633d3956e2d6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:14.827076 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-6db9e04c-b55e-4e52-856c-4a43197a4299 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:14.833978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-22012103-adb3-494a-8577-633d3956e2d6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66/os-volume_attachments/8f600fe9-87d2-4d23-90bd-81e757f43aed" status: 200 len: 194 microversion: 2.1 time: 0.046328 Jul 05 16:15:14.834875 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 427/851] 10.222.0.45 () {58 vars in 1412 bytes} [Tue Jul 5 16:15:14 2022] GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66/os-volume_attachments/8f600fe9-87d2-4d23-90bd-81e757f43aed => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:15:14.837185 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-6db9e04c-b55e-4e52-856c-4a43197a4299 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:14.838700 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-6db9e04c-b55e-4e52-856c-4a43197a4299 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:14.840060 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-6db9e04c-b55e-4e52-856c-4a43197a4299 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1715 microversion: 2.20 time: 0.200938 Jul 05 16:15:14.840616 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 425/852] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:15:14 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1715 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:15:16.278566 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-97abce5d-490c-4c7e-888c-9d2ae5a860cd tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90570a59-fba3-4441-8d69-80235a5ca35f"}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:15:16.279624 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-97abce5d-490c-4c7e-888c-9d2ae5a860cd tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:16.287025 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-97abce5d-490c-4c7e-888c-9d2ae5a860cd tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:16.287476 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-97abce5d-490c-4c7e-888c-9d2ae5a860cd tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:16.288241 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-97abce5d-490c-4c7e-888c-9d2ae5a860cd tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:16.288679 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-97abce5d-490c-4c7e-888c-9d2ae5a860cd tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:16.940327 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-439d6f55-47c9-4453-b0ef-50faf48f6425 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5cfd45dd-46c3-47df-a3e2-acb7f5dfd2d1"}} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:15:16.942219 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-439d6f55-47c9-4453-b0ef-50faf48f6425 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:16.948013 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-439d6f55-47c9-4453-b0ef-50faf48f6425 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:16.948463 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-439d6f55-47c9-4453-b0ef-50faf48f6425 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:16.949284 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-439d6f55-47c9-4453-b0ef-50faf48f6425 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:16.949719 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-439d6f55-47c9-4453-b0ef-50faf48f6425 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:17.045887 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-97abce5d-490c-4c7e-888c-9d2ae5a860cd tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "POST /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.770930 Jul 05 16:15:17.046900 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 428/853] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Jul 5 16:15:16 2022] POST /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39/os-volume_attachments => generated 194 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:15:17.667451 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-439d6f55-47c9-4453-b0ef-50faf48f6425 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "POST /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.730912 Jul 05 16:15:17.671630 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 426/854] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Jul 5 16:15:16 2022] POST /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66/os-volume_attachments => generated 194 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:15:24.805575 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-2ab6400c-4455-4cd8-9064-60f594c9a9c9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:24.806157 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-2ab6400c-4455-4cd8-9064-60f594c9a9c9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:24.813362 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2ab6400c-4455-4cd8-9064-60f594c9a9c9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:24.813822 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2ab6400c-4455-4cd8-9064-60f594c9a9c9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:24.814631 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2ab6400c-4455-4cd8-9064-60f594c9a9c9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:24.815077 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2ab6400c-4455-4cd8-9064-60f594c9a9c9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:24.897701 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.objects.instance [None req-2ab6400c-4455-4cd8-9064-60f594c9a9c9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lazy-loading 'services' on Instance uuid 52a25436-864d-4302-9b41-f9f904dfaa39 {{(pid=118320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 16:15:25.165933 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-2ab6400c-4455-4cd8-9064-60f594c9a9c9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "DELETE /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39/os-volume_attachments/90570a59-fba3-4441-8d69-80235a5ca35f" status: 202 len: 0 microversion: 2.1 time: 0.364702 Jul 05 16:15:25.166522 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 429/855] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Jul 5 16:15:24 2022] DELETE /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39/os-volume_attachments/90570a59-fba3-4441-8d69-80235a5ca35f => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 16:15:25.176186 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-8f9d60ab-1f72-4133-b2ea-cc3a1778eff2 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:25.177917 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-8f9d60ab-1f72-4133-b2ea-cc3a1778eff2 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:25.179900 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:15:25.184872 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8f9d60ab-1f72-4133-b2ea-cc3a1778eff2 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:25.185309 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8f9d60ab-1f72-4133-b2ea-cc3a1778eff2 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:25.186073 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8f9d60ab-1f72-4133-b2ea-cc3a1778eff2 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:25.186554 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-8f9d60ab-1f72-4133-b2ea-cc3a1778eff2 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:25.215564 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-8f9d60ab-1f72-4133-b2ea-cc3a1778eff2 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044381 Jul 05 16:15:25.216111 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 427/856] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Jul 5 16:15:25 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:15:26.228501 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-6375167a-4b31-4ba2-82ce-c88293fd8e74 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:26.229604 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-6375167a-4b31-4ba2-82ce-c88293fd8e74 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:26.236483 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6375167a-4b31-4ba2-82ce-c88293fd8e74 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:26.236971 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6375167a-4b31-4ba2-82ce-c88293fd8e74 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:26.237737 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6375167a-4b31-4ba2-82ce-c88293fd8e74 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:26.238177 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6375167a-4b31-4ba2-82ce-c88293fd8e74 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:26.265867 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-6375167a-4b31-4ba2-82ce-c88293fd8e74 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042322 Jul 05 16:15:26.266407 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 430/857] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Jul 5 16:15:26 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:15:27.277042 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-2a3d845d-4867-4f59-9a55-8b0be0085ce1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:27.277956 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-2a3d845d-4867-4f59-9a55-8b0be0085ce1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:27.284873 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2a3d845d-4867-4f59-9a55-8b0be0085ce1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:27.285344 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2a3d845d-4867-4f59-9a55-8b0be0085ce1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:27.286612 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2a3d845d-4867-4f59-9a55-8b0be0085ce1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:27.287047 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2a3d845d-4867-4f59-9a55-8b0be0085ce1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:27.315920 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-2a3d845d-4867-4f59-9a55-8b0be0085ce1 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043297 Jul 05 16:15:27.316474 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 428/858] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Jul 5 16:15:27 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:15:28.327191 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-db91e04b-da58-4457-aa0d-ee11bf6aa249 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:28.328123 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-db91e04b-da58-4457-aa0d-ee11bf6aa249 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:28.335078 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-db91e04b-da58-4457-aa0d-ee11bf6aa249 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:28.335535 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-db91e04b-da58-4457-aa0d-ee11bf6aa249 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:28.336300 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-db91e04b-da58-4457-aa0d-ee11bf6aa249 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:28.336741 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-db91e04b-da58-4457-aa0d-ee11bf6aa249 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:28.365237 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-db91e04b-da58-4457-aa0d-ee11bf6aa249 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042006 Jul 05 16:15:28.365889 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 431/859] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Jul 5 16:15:28 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:15:29.378600 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-693c98cd-80b6-4871-9b92-c48bfe73658a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:29.379516 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-693c98cd-80b6-4871-9b92-c48bfe73658a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:29.385859 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-693c98cd-80b6-4871-9b92-c48bfe73658a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:29.386308 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-693c98cd-80b6-4871-9b92-c48bfe73658a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:29.387066 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-693c98cd-80b6-4871-9b92-c48bfe73658a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:29.387502 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-693c98cd-80b6-4871-9b92-c48bfe73658a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:29.391073 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:15:29.415730 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-693c98cd-80b6-4871-9b92-c48bfe73658a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041384 Jul 05 16:15:29.416283 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 429/860] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Jul 5 16:15:29 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:15:30.427930 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-c39e5fbe-d242-4856-b00b-da3f2a473530 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:30.428909 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-c39e5fbe-d242-4856-b00b-da3f2a473530 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:30.435336 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c39e5fbe-d242-4856-b00b-da3f2a473530 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:30.435787 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c39e5fbe-d242-4856-b00b-da3f2a473530 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:30.436557 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c39e5fbe-d242-4856-b00b-da3f2a473530 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:30.437027 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c39e5fbe-d242-4856-b00b-da3f2a473530 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:30.465392 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-c39e5fbe-d242-4856-b00b-da3f2a473530 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042097 Jul 05 16:15:30.465939 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 432/861] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Jul 5 16:15:30 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:15:31.479252 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-aea009cb-f6bf-483e-9094-c1687136fe88 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:31.480206 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-aea009cb-f6bf-483e-9094-c1687136fe88 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:31.487465 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-aea009cb-f6bf-483e-9094-c1687136fe88 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:31.488024 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-aea009cb-f6bf-483e-9094-c1687136fe88 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:31.494814 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-aea009cb-f6bf-483e-9094-c1687136fe88 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:31.494814 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-aea009cb-f6bf-483e-9094-c1687136fe88 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:31.504008 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-4a6530cd-c615-4f9c-9d23-a878ad9f7622 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:31.504984 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-4a6530cd-c615-4f9c-9d23-a878ad9f7622 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:31.511617 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4a6530cd-c615-4f9c-9d23-a878ad9f7622 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:31.512126 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4a6530cd-c615-4f9c-9d23-a878ad9f7622 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:31.513123 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4a6530cd-c615-4f9c-9d23-a878ad9f7622 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:31.513714 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4a6530cd-c615-4f9c-9d23-a878ad9f7622 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:31.523745 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-aea009cb-f6bf-483e-9094-c1687136fe88 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049645 Jul 05 16:15:31.524343 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 430/862] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Jul 5 16:15:31 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:15:31.550253 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-4a6530cd-c615-4f9c-9d23-a878ad9f7622 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050283 Jul 05 16:15:31.550823 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 433/863] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Jul 5 16:15:31 2022] GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:15:31.695799 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-600984a2-d024-4878-9c71-c1ef351d1041 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:31.696289 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-600984a2-d024-4878-9c71-c1ef351d1041 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:31.703291 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-600984a2-d024-4878-9c71-c1ef351d1041 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:31.703757 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-600984a2-d024-4878-9c71-c1ef351d1041 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:31.704514 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-600984a2-d024-4878-9c71-c1ef351d1041 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:31.704980 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-600984a2-d024-4878-9c71-c1ef351d1041 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:31.738219 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-600984a2-d024-4878-9c71-c1ef351d1041 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66/os-volume_attachments/8f600fe9-87d2-4d23-90bd-81e757f43aed" status: 200 len: 194 microversion: 2.1 time: 0.047185 Jul 05 16:15:31.738831 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 431/864] 10.222.0.45 () {58 vars in 1412 bytes} [Tue Jul 5 16:15:31 2022] GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66/os-volume_attachments/8f600fe9-87d2-4d23-90bd-81e757f43aed => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:15:31.750584 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-a65324bf-d93f-4c24-9952-74f0c76d51a8 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:31.751288 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-a65324bf-d93f-4c24-9952-74f0c76d51a8 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:31.758890 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a65324bf-d93f-4c24-9952-74f0c76d51a8 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:31.759347 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a65324bf-d93f-4c24-9952-74f0c76d51a8 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:31.760124 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a65324bf-d93f-4c24-9952-74f0c76d51a8 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:31.760574 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a65324bf-d93f-4c24-9952-74f0c76d51a8 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:31.840093 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.objects.instance [None req-a65324bf-d93f-4c24-9952-74f0c76d51a8 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lazy-loading 'services' on Instance uuid c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 {{(pid=118320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 16:15:32.033443 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-a65324bf-d93f-4c24-9952-74f0c76d51a8 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66/os-volume_attachments/8f600fe9-87d2-4d23-90bd-81e757f43aed" status: 202 len: 0 microversion: 2.1 time: 0.288382 Jul 05 16:15:32.034257 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 434/865] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Jul 5 16:15:31 2022] DELETE /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66/os-volume_attachments/8f600fe9-87d2-4d23-90bd-81e757f43aed => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 16:15:32.535026 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-b96ce00d-4d12-467b-8eb9-4df0138a530a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:32.536378 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-b96ce00d-4d12-467b-8eb9-4df0138a530a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:32.543349 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b96ce00d-4d12-467b-8eb9-4df0138a530a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:32.543802 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b96ce00d-4d12-467b-8eb9-4df0138a530a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:32.544572 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b96ce00d-4d12-467b-8eb9-4df0138a530a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:32.545037 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-b96ce00d-4d12-467b-8eb9-4df0138a530a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:32.575019 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-b96ce00d-4d12-467b-8eb9-4df0138a530a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044028 Jul 05 16:15:32.575580 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 432/866] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Jul 5 16:15:32 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:15:33.587071 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-dd2d65da-ea64-444a-bb36-27857149382f tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:33.588043 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-dd2d65da-ea64-444a-bb36-27857149382f tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:33.594286 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dd2d65da-ea64-444a-bb36-27857149382f tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:33.594731 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dd2d65da-ea64-444a-bb36-27857149382f tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:33.595487 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dd2d65da-ea64-444a-bb36-27857149382f tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:33.595921 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dd2d65da-ea64-444a-bb36-27857149382f tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:33.624478 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-dd2d65da-ea64-444a-bb36-27857149382f tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042706 Jul 05 16:15:33.625056 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 435/867] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Jul 5 16:15:33 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:15:34.636342 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-ef13ad82-7a7c-436b-8c5f-642e918f685a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:34.637344 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-ef13ad82-7a7c-436b-8c5f-642e918f685a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:34.643739 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ef13ad82-7a7c-436b-8c5f-642e918f685a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:34.644184 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ef13ad82-7a7c-436b-8c5f-642e918f685a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:34.644969 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ef13ad82-7a7c-436b-8c5f-642e918f685a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:34.645989 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-ef13ad82-7a7c-436b-8c5f-642e918f685a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:34.674775 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-ef13ad82-7a7c-436b-8c5f-642e918f685a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042643 Jul 05 16:15:34.675338 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 433/868] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Jul 5 16:15:34 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:15:35.686694 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-7815ec1c-d808-460a-88eb-3c083aa39926 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:35.687628 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-7815ec1c-d808-460a-88eb-3c083aa39926 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:35.694264 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7815ec1c-d808-460a-88eb-3c083aa39926 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:35.694725 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7815ec1c-d808-460a-88eb-3c083aa39926 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:35.695494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7815ec1c-d808-460a-88eb-3c083aa39926 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:35.695936 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7815ec1c-d808-460a-88eb-3c083aa39926 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:35.726370 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-7815ec1c-d808-460a-88eb-3c083aa39926 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043533 Jul 05 16:15:35.732414 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 436/869] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Jul 5 16:15:35 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 05 16:15:35.789027 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-2466a33d-9788-4f97-982d-bee702c74fb2 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:35.789542 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-2466a33d-9788-4f97-982d-bee702c74fb2 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:35.796303 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2466a33d-9788-4f97-982d-bee702c74fb2 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:35.796744 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2466a33d-9788-4f97-982d-bee702c74fb2 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:35.797526 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2466a33d-9788-4f97-982d-bee702c74fb2 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:35.797961 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-2466a33d-9788-4f97-982d-bee702c74fb2 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:35.822189 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-2466a33d-9788-4f97-982d-bee702c74fb2 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Going to try to terminate instance {{(pid=118319) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 16:15:36.137419 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-2466a33d-9788-4f97-982d-bee702c74fb2 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "DELETE /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39" status: 204 len: 0 microversion: 2.1 time: 0.352676 Jul 05 16:15:36.138016 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 434/870] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Jul 5 16:15:35 2022] DELETE /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 16:15:36.146705 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-ae81c32e-6155-427e-9323-43d76c55d7e9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:36.147326 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-ae81c32e-6155-427e-9323-43d76c55d7e9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:36.153190 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ae81c32e-6155-427e-9323-43d76c55d7e9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:36.153640 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ae81c32e-6155-427e-9323-43d76c55d7e9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:36.154407 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ae81c32e-6155-427e-9323-43d76c55d7e9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:36.154844 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ae81c32e-6155-427e-9323-43d76c55d7e9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:36.291021 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-ae81c32e-6155-427e-9323-43d76c55d7e9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:36.297905 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-ae81c32e-6155-427e-9323-43d76c55d7e9 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39" status: 200 len: 1680 microversion: 2.1 time: 0.155606 Jul 05 16:15:36.298750 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 437/871] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:15:36 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:15:36.322090 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-06a4130a-9ca2-44de-be93-07f1a69aded6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:36.322700 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-06a4130a-9ca2-44de-be93-07f1a69aded6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:36.328902 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-06a4130a-9ca2-44de-be93-07f1a69aded6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:36.329417 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-06a4130a-9ca2-44de-be93-07f1a69aded6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:36.330206 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-06a4130a-9ca2-44de-be93-07f1a69aded6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:36.330643 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-06a4130a-9ca2-44de-be93-07f1a69aded6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:36.360641 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-06a4130a-9ca2-44de-be93-07f1a69aded6 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66/os-volume_attachments/5cfd45dd-46c3-47df-a3e2-acb7f5dfd2d1" status: 200 len: 194 microversion: 2.1 time: 0.043756 Jul 05 16:15:36.361249 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 435/872] 10.222.0.45 () {58 vars in 1412 bytes} [Tue Jul 5 16:15:36 2022] GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66/os-volume_attachments/5cfd45dd-46c3-47df-a3e2-acb7f5dfd2d1 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:15:36.370919 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-a886e7bb-8517-4cd2-984d-c94de49a6b6e tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:36.371437 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-a886e7bb-8517-4cd2-984d-c94de49a6b6e tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:36.377390 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a886e7bb-8517-4cd2-984d-c94de49a6b6e tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:36.377854 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a886e7bb-8517-4cd2-984d-c94de49a6b6e tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:36.378616 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a886e7bb-8517-4cd2-984d-c94de49a6b6e tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:36.379055 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a886e7bb-8517-4cd2-984d-c94de49a6b6e tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:36.458291 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.objects.instance [None req-a886e7bb-8517-4cd2-984d-c94de49a6b6e tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lazy-loading 'services' on Instance uuid c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 {{(pid=118320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 16:15:36.708115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-a886e7bb-8517-4cd2-984d-c94de49a6b6e tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66/os-volume_attachments/5cfd45dd-46c3-47df-a3e2-acb7f5dfd2d1" status: 202 len: 0 microversion: 2.1 time: 0.340432 Jul 05 16:15:36.708743 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 438/873] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Jul 5 16:15:36 2022] DELETE /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66/os-volume_attachments/5cfd45dd-46c3-47df-a3e2-acb7f5dfd2d1 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 16:15:37.315454 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-a93b4420-0f15-4639-95ee-23fb95f0a806 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:37.316074 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-a93b4420-0f15-4639-95ee-23fb95f0a806 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:37.322522 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a93b4420-0f15-4639-95ee-23fb95f0a806 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:37.322973 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a93b4420-0f15-4639-95ee-23fb95f0a806 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:37.323740 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a93b4420-0f15-4639-95ee-23fb95f0a806 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:37.324181 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-a93b4420-0f15-4639-95ee-23fb95f0a806 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:37.451155 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-a93b4420-0f15-4639-95ee-23fb95f0a806 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:37.458752 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-a93b4420-0f15-4639-95ee-23fb95f0a806 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39" status: 200 len: 1680 microversion: 2.1 time: 0.147158 Jul 05 16:15:37.459327 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 436/874] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:15:37 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39 => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:15:38.476570 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-47b27b7f-0c9a-47f0-a06c-eed66753d460 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:38.477376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-47b27b7f-0c9a-47f0-a06c-eed66753d460 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:38.483711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-47b27b7f-0c9a-47f0-a06c-eed66753d460 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:38.484163 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-47b27b7f-0c9a-47f0-a06c-eed66753d460 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:38.485227 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-47b27b7f-0c9a-47f0-a06c-eed66753d460 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:38.485691 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-47b27b7f-0c9a-47f0-a06c-eed66753d460 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:38.614773 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-47b27b7f-0c9a-47f0-a06c-eed66753d460 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:38.622181 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-47b27b7f-0c9a-47f0-a06c-eed66753d460 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39" status: 200 len: 1680 microversion: 2.1 time: 0.150410 Jul 05 16:15:38.622745 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 439/875] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:15:38 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:15:39.639578 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-7632d7d2-b7bd-4e49-bf93-fc87bede708f tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:39.640194 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-7632d7d2-b7bd-4e49-bf93-fc87bede708f tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:39.647405 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7632d7d2-b7bd-4e49-bf93-fc87bede708f tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:39.647856 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7632d7d2-b7bd-4e49-bf93-fc87bede708f tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:39.648681 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7632d7d2-b7bd-4e49-bf93-fc87bede708f tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:39.649250 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-7632d7d2-b7bd-4e49-bf93-fc87bede708f tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:39.882686 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.policy [None req-7632d7d2-b7bd-4e49-bf93-fc87bede708f tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118319) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:39.890277 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-7632d7d2-b7bd-4e49-bf93-fc87bede708f tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39" status: 200 len: 1680 microversion: 2.1 time: 0.254553 Jul 05 16:15:39.890856 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 437/876] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:15:39 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39 => generated 1680 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:15:39.982521 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-dd64fa7e-6a02-417a-8df2-2814fa8f7263 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:39.985128 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-dd64fa7e-6a02-417a-8df2-2814fa8f7263 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:39.991223 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dd64fa7e-6a02-417a-8df2-2814fa8f7263 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:39.991919 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dd64fa7e-6a02-417a-8df2-2814fa8f7263 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:39.992732 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dd64fa7e-6a02-417a-8df2-2814fa8f7263 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:39.993204 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dd64fa7e-6a02-417a-8df2-2814fa8f7263 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:40.017260 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=4 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:15:40.029129 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-dd64fa7e-6a02-417a-8df2-2814fa8f7263 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050898 Jul 05 16:15:40.029721 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 440/877] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Jul 5 16:15:39 2022] GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 16:15:40.150946 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [None req-1a92b9a4-d158-4472-a375-1e7b268e7e42 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:40.151866 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.compute.api [None req-1a92b9a4-d158-4472-a375-1e7b268e7e42 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66] Fetching instance by UUID {{(pid=118319) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:40.158257 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1a92b9a4-d158-4472-a375-1e7b268e7e42 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:40.158740 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1a92b9a4-d158-4472-a375-1e7b268e7e42 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:40.159514 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1a92b9a4-d158-4472-a375-1e7b268e7e42 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:40.159956 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [None req-1a92b9a4-d158-4472-a375-1e7b268e7e42 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:40.191840 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [None req-1a92b9a4-d158-4472-a375-1e7b268e7e42 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045439 Jul 05 16:15:40.194224 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 438/878] 10.222.0.45 () {58 vars in 1301 bytes} [Tue Jul 5 16:15:40 2022] GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 16:15:40.263567 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-e9253634-d5d1-4367-88c2-4eccea292d37 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:40.264073 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-e9253634-d5d1-4367-88c2-4eccea292d37 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:40.276579 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e9253634-d5d1-4367-88c2-4eccea292d37 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:40.276579 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e9253634-d5d1-4367-88c2-4eccea292d37 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:40.276579 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e9253634-d5d1-4367-88c2-4eccea292d37 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:40.276579 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e9253634-d5d1-4367-88c2-4eccea292d37 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:40.304850 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-e9253634-d5d1-4367-88c2-4eccea292d37 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66] Going to try to terminate instance {{(pid=118320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 16:15:40.534961 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG nova.api.openstack.wsgi [req-203e1138-cec5-4dea-b8cd-abf124ceab9e req-94286d00-5f09-4874-bf83-ec2dde8d3dfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52a25436-864d-4302-9b41-f9f904dfaa39", "name": "network-vif-deleted", "tag": "9ac8cbc0-45bd-47dc-8eb3-b69db5ea2a18"}]} {{(pid=118319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:15:40.544303 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-203e1138-cec5-4dea-b8cd-abf124ceab9e req-94286d00-5f09-4874-bf83-ec2dde8d3dfd service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:40.545347 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG oslo_concurrency.lockutils [req-203e1138-cec5-4dea-b8cd-abf124ceab9e req-94286d00-5f09-4874-bf83-ec2dde8d3dfd service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:40.563193 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.compute.server_external_events [req-203e1138-cec5-4dea-b8cd-abf124ceab9e req-94286d00-5f09-4874-bf83-ec2dde8d3dfd service nova] Creating event network-vif-deleted:9ac8cbc0-45bd-47dc-8eb3-b69db5ea2a18 for instance 52a25436-864d-4302-9b41-f9f904dfaa39 on hv-cinder-84875 Jul 05 16:15:40.569003 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO nova.api.openstack.requestlog [req-203e1138-cec5-4dea-b8cd-abf124ceab9e req-94286d00-5f09-4874-bf83-ec2dde8d3dfd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037491 Jul 05 16:15:40.574191 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: [pid: 118319|app: 0|req: 439/879] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:15:40.664550 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-e9253634-d5d1-4367-88c2-4eccea292d37 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66" status: 204 len: 0 microversion: 2.1 time: 0.404479 Jul 05 16:15:40.671291 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 441/880] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Jul 5 16:15:40 2022] DELETE /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 16:15:40.678489 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 16:15:40.683873 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Tue Jul 5 16:15:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 (ip 10.222.0.45) !!! Jul 05 16:15:40.704196 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Traceback (most recent call last): Jul 05 16:15:40.704402 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jul 05 16:15:40.704402 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: timer() Jul 05 16:15:40.704402 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jul 05 16:15:40.704402 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: cb(*args, **kw) Jul 05 16:15:40.704402 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Jul 05 16:15:40.704402 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: waiter.switch() Jul 05 16:15:40.704402 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: greenlet.error: cannot switch to a different thread Jul 05 16:15:40.908158 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-26a4c79d-a190-4a92-a480-630ea5babeb5 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:40.908934 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-26a4c79d-a190-4a92-a480-630ea5babeb5 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:40.916012 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-26a4c79d-a190-4a92-a480-630ea5babeb5 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:40.916470 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-26a4c79d-a190-4a92-a480-630ea5babeb5 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:40.917288 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-26a4c79d-a190-4a92-a480-630ea5babeb5 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:40.917726 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-26a4c79d-a190-4a92-a480-630ea5babeb5 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:40.983624 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-26a4c79d-a190-4a92-a480-630ea5babeb5 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:40.992518 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-26a4c79d-a190-4a92-a480-630ea5babeb5 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39" status: 200 len: 1326 microversion: 2.1 time: 0.088608 Jul 05 16:15:41.002524 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 442/881] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:15:40 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39 => generated 1326 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:15:42.010513 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-bca12f0f-0d57-4adb-b38f-a3632d83728d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:42.011186 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-bca12f0f-0d57-4adb-b38f-a3632d83728d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:42.017546 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bca12f0f-0d57-4adb-b38f-a3632d83728d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:42.018002 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bca12f0f-0d57-4adb-b38f-a3632d83728d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:42.018769 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bca12f0f-0d57-4adb-b38f-a3632d83728d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:42.019213 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bca12f0f-0d57-4adb-b38f-a3632d83728d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:42.081841 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-bca12f0f-0d57-4adb-b38f-a3632d83728d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8512e7c1704fac9cc4fcfe3bf1f18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e6ad67dbf542528726c545872ac10c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:42.089886 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-bca12f0f-0d57-4adb-b38f-a3632d83728d tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39" status: 200 len: 1326 microversion: 2.1 time: 0.083279 Jul 05 16:15:42.091414 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 443/882] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:15:42 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39 => generated 1326 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:15:43.107663 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-3d6aaaea-09c7-4da7-832c-a97c10d5bac2 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:43.108306 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-3d6aaaea-09c7-4da7-832c-a97c10d5bac2 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:43.115128 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3d6aaaea-09c7-4da7-832c-a97c10d5bac2 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:43.115575 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3d6aaaea-09c7-4da7-832c-a97c10d5bac2 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:43.116351 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3d6aaaea-09c7-4da7-832c-a97c10d5bac2 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:43.116813 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3d6aaaea-09c7-4da7-832c-a97c10d5bac2 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:43.131008 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-3d6aaaea-09c7-4da7-832c-a97c10d5bac2 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] HTTP exception thrown: Instance 52a25436-864d-4302-9b41-f9f904dfaa39 could not be found. Jul 05 16:15:43.132666 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-3d6aaaea-09c7-4da7-832c-a97c10d5bac2 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Request method failure captured: Jul 05 16:15:43.132666 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39 HTTP/1.1 Jul 05 16:15:43.132666 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:15:43.132666 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:15:43.132666 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:15:43.132666 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:15:43.132666 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:15:43.132666 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:15:43.132666 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:15:43.132666 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:15:43.132666 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIcG6oJHBbOiV-hRrdMXuy13iZZ6hvCfk-vTWz4vq2ula5Qwq5GKAKhC7pohxgL-mMXAkQ0I8c07z_L-klhBhC6mFKTl8PgxIghG2kxSHmXvGruMCHGJe1XXCXlDVgGJeXVlaQZZep4KSMSbhku1jx5l6fL00FOe6C27ag91K3fk98 Jul 05 16:15:43.132666 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:15:43.132666 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:15:43.132666 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:15:43.132666 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:15:43.132666 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:15:43.132666 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:15:43.132666 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 42e6ad67dbf542528726c545872ac10c Jul 05 16:15:43.132666 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:15:43.132666 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:15:43.132666 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:15:43.134385 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_42e6ad67dbf542528726c545872ac10c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:15:43.134385 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:15:43.134385 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 42e6ad67dbf542528726c545872ac10c Jul 05 16:15:43.134385 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:15:43.134385 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-AttachVolumeNegativeTest-547019280-project Jul 05 16:15:43.134385 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:15:43.134385 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:15:43.134385 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: 0c8512e7c1704fac9cc4fcfe3bf1f18b Jul 05 16:15:43.134385 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-AttachVolumeNegativeTest-547019280-project Jul 05 16:15:43.134385 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:15:43.134385 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance 52a25436-864d-4302-9b41-f9f904dfaa39 could not be found. Jul 05 16:15:43.134385 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': '52a25436-864d-4302-9b41-f9f904dfaa39'} Jul 05 16:15:43.135218 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:15:43.135218 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:43.135218 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:15:43.135218 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:15:43.135218 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:15:43.135218 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:15:43.135218 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:15:43.135218 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:15:43.135218 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:15:43.135218 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:15:43.135218 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52a25436-864d-4302-9b41-f9f904dfaa39 could not be found. Jul 05 16:15:43.135218 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:43.135218 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:15:43.135218 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:43.135218 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:43.135218 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:15:43.135218 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:15:43.135218 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:15:43.135218 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:15:43.135218 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:15:43.136479 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:15:43.136479 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 16:15:43.136479 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 16:15:43.136479 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:15:43.136479 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:15:43.136479 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:15:43.136479 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:15:43.136479 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52a25436-864d-4302-9b41-f9f904dfaa39 could not be found. Jul 05 16:15:43.136479 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:43.136479 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:15:43.136479 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:43.136479 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:43.136479 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:15:43.136479 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:15:43.136479 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:15:43.136479 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:15:43.136479 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52a25436-864d-4302-9b41-f9f904dfaa39 could not be found. Jul 05 16:15:43.136479 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:43.137620 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-3d6aaaea-09c7-4da7-832c-a97c10d5bac2 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Returning 404 to user: Instance 52a25436-864d-4302-9b41-f9f904dfaa39 could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:15:43.137620 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-3d6aaaea-09c7-4da7-832c-a97c10d5bac2 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39" status: 404 len: 111 microversion: 2.1 time: 0.030470 Jul 05 16:15:43.137620 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 444/883] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:15:43 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 16:15:43.142831 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-cd821b0b-3825-440b-95ce-33f811530886 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '.version_select at 0x7f3087ec9550>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:43.216674 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-cd821b0b-3825-440b-95ce-33f811530886 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1890608426" status: 202 len: 0 microversion: 2.1 time: 0.077419 Jul 05 16:15:43.217410 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 445/884] 10.222.0.45 () {58 vars in 1220 bytes} [Tue Jul 5 16:15:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1890608426 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 05 16:15:43.859378 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-a36c00ed-3a8f-4c27-b6dc-5eef407514ea req-69a58e71-b9ef-4c58-a9fb-79c6a46509b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66", "name": "network-vif-deleted", "tag": "af3d3482-5215-478e-a23e-301b57f33edd"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:15:43.872277 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-a36c00ed-3a8f-4c27-b6dc-5eef407514ea req-69a58e71-b9ef-4c58-a9fb-79c6a46509b3 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:43.872277 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-a36c00ed-3a8f-4c27-b6dc-5eef407514ea req-69a58e71-b9ef-4c58-a9fb-79c6a46509b3 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:43.893951 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-a36c00ed-3a8f-4c27-b6dc-5eef407514ea req-69a58e71-b9ef-4c58-a9fb-79c6a46509b3 service nova] Creating event network-vif-deleted:af3d3482-5215-478e-a23e-301b57f33edd for instance c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 on hv-cinder-84875 Jul 05 16:15:43.899899 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-a36c00ed-3a8f-4c27-b6dc-5eef407514ea req-69a58e71-b9ef-4c58-a9fb-79c6a46509b3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044610 Jul 05 16:15:43.901416 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 446/885] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:15:45.560489 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-f56a0d0d-d7f8-4c51-871e-ec8469c210e0 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:45.561141 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-f56a0d0d-d7f8-4c51-871e-ec8469c210e0 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:45.563085 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:15:45.568871 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f56a0d0d-d7f8-4c51-871e-ec8469c210e0 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:45.576863 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f56a0d0d-d7f8-4c51-871e-ec8469c210e0 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:45.576863 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f56a0d0d-d7f8-4c51-871e-ec8469c210e0 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:45.576863 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f56a0d0d-d7f8-4c51-871e-ec8469c210e0 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:45.583573 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-f56a0d0d-d7f8-4c51-871e-ec8469c210e0 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] HTTP exception thrown: Instance 52a25436-864d-4302-9b41-f9f904dfaa39 could not be found. Jul 05 16:15:45.585220 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-f56a0d0d-d7f8-4c51-871e-ec8469c210e0 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Request method failure captured: Jul 05 16:15:45.585220 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: DELETE /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39 HTTP/1.1 Jul 05 16:15:45.585220 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:15:45.585220 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:15:45.585220 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:15:45.585220 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:15:45.585220 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:15:45.585220 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:15:45.585220 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:15:45.585220 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:15:45.585220 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIcG6oJHBbOiV-hRrdMXuy13iZZ6hvCfk-vTWz4vq2ula5Qwq5GKAKhC7pohxgL-mMXAkQ0I8c07z_L-klhBhC6mFKTl8PgxIghG2kxSHmXvGruMCHGJe1XXCXlDVgGJeXVlaQZZep4KSMSbhku1jx5l6fL00FOe6C27ag91K3fk98 Jul 05 16:15:45.585220 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:15:45.585220 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:15:45.585220 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:15:45.585220 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:15:45.585220 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:15:45.585220 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:15:45.585220 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 42e6ad67dbf542528726c545872ac10c Jul 05 16:15:45.585220 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:15:45.585220 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:15:45.585220 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:15:45.586742 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_42e6ad67dbf542528726c545872ac10c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:15:45.586742 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:15:45.586742 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 42e6ad67dbf542528726c545872ac10c Jul 05 16:15:45.586742 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:15:45.586742 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-AttachVolumeNegativeTest-547019280-project Jul 05 16:15:45.586742 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:15:45.586742 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:15:45.586742 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: 0c8512e7c1704fac9cc4fcfe3bf1f18b Jul 05 16:15:45.586742 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-AttachVolumeNegativeTest-547019280-project Jul 05 16:15:45.586742 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:15:45.586742 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance 52a25436-864d-4302-9b41-f9f904dfaa39 could not be found. Jul 05 16:15:45.586742 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': '52a25436-864d-4302-9b41-f9f904dfaa39'} Jul 05 16:15:45.587637 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:15:45.587637 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:45.587637 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:15:45.587637 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:15:45.587637 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:15:45.587637 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:15:45.587637 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:15:45.587637 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:15:45.587637 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:15:45.587637 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:15:45.587637 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52a25436-864d-4302-9b41-f9f904dfaa39 could not be found. Jul 05 16:15:45.587637 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:45.587637 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:15:45.587637 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:45.587637 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:45.587637 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:15:45.587637 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:15:45.587637 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:15:45.587637 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:15:45.587637 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:15:45.589067 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:15:45.589067 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 16:15:45.589067 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 16:15:45.589067 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 16:15:45.589067 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 16:15:45.589067 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:15:45.589067 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:15:45.589067 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:15:45.589067 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:15:45.589067 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52a25436-864d-4302-9b41-f9f904dfaa39 could not be found. Jul 05 16:15:45.589067 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:45.589067 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:15:45.589067 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:45.589067 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:45.589067 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:15:45.589067 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:15:45.589067 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:15:45.589067 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:15:45.589067 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52a25436-864d-4302-9b41-f9f904dfaa39 could not be found. Jul 05 16:15:45.589067 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:45.590538 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-f56a0d0d-d7f8-4c51-871e-ec8469c210e0 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Returning 404 to user: Instance 52a25436-864d-4302-9b41-f9f904dfaa39 could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:15:45.590538 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-f56a0d0d-d7f8-4c51-871e-ec8469c210e0 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "DELETE /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39" status: 404 len: 111 microversion: 2.1 time: 0.030818 Jul 05 16:15:45.590538 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 447/886] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Jul 5 16:15:45 2022] DELETE /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 16:15:45.594469 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-15493be7-4ff1-4e65-8c00-be6d071af869 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:45.595087 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-15493be7-4ff1-4e65-8c00-be6d071af869 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 52a25436-864d-4302-9b41-f9f904dfaa39] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:45.601310 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-15493be7-4ff1-4e65-8c00-be6d071af869 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:45.601769 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-15493be7-4ff1-4e65-8c00-be6d071af869 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:45.602590 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-15493be7-4ff1-4e65-8c00-be6d071af869 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:45.603042 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-15493be7-4ff1-4e65-8c00-be6d071af869 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:45.616785 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-15493be7-4ff1-4e65-8c00-be6d071af869 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] HTTP exception thrown: Instance 52a25436-864d-4302-9b41-f9f904dfaa39 could not be found. Jul 05 16:15:45.618271 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-15493be7-4ff1-4e65-8c00-be6d071af869 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Request method failure captured: Jul 05 16:15:45.618271 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39 HTTP/1.1 Jul 05 16:15:45.618271 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:15:45.618271 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:15:45.618271 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:15:45.618271 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:15:45.618271 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:15:45.618271 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:15:45.618271 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:15:45.618271 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:15:45.618271 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIcG6oJHBbOiV-hRrdMXuy13iZZ6hvCfk-vTWz4vq2ula5Qwq5GKAKhC7pohxgL-mMXAkQ0I8c07z_L-klhBhC6mFKTl8PgxIghG2kxSHmXvGruMCHGJe1XXCXlDVgGJeXVlaQZZep4KSMSbhku1jx5l6fL00FOe6C27ag91K3fk98 Jul 05 16:15:45.618271 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:15:45.618271 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:15:45.618271 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:15:45.618271 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:15:45.618271 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:15:45.618271 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:15:45.618271 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 42e6ad67dbf542528726c545872ac10c Jul 05 16:15:45.618271 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:15:45.618271 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:15:45.618271 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:15:45.619792 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_42e6ad67dbf542528726c545872ac10c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:15:45.619792 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:15:45.619792 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 42e6ad67dbf542528726c545872ac10c Jul 05 16:15:45.619792 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:15:45.619792 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-AttachVolumeNegativeTest-547019280-project Jul 05 16:15:45.619792 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:15:45.619792 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:15:45.619792 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: 0c8512e7c1704fac9cc4fcfe3bf1f18b Jul 05 16:15:45.619792 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-AttachVolumeNegativeTest-547019280-project Jul 05 16:15:45.619792 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:15:45.619792 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance 52a25436-864d-4302-9b41-f9f904dfaa39 could not be found. Jul 05 16:15:45.619792 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': '52a25436-864d-4302-9b41-f9f904dfaa39'} Jul 05 16:15:45.620575 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:15:45.620575 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:45.620575 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:15:45.620575 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:15:45.620575 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:15:45.620575 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:15:45.620575 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:15:45.620575 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:15:45.620575 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:15:45.620575 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:15:45.620575 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52a25436-864d-4302-9b41-f9f904dfaa39 could not be found. Jul 05 16:15:45.620575 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:45.620575 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:15:45.620575 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:45.620575 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:45.620575 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:15:45.620575 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:15:45.620575 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:15:45.620575 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:15:45.620575 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:15:45.621860 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:15:45.621860 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 16:15:45.621860 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 16:15:45.621860 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:15:45.621860 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:15:45.621860 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:15:45.621860 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:15:45.621860 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52a25436-864d-4302-9b41-f9f904dfaa39 could not be found. Jul 05 16:15:45.621860 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:45.621860 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:15:45.621860 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:45.621860 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:45.621860 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:15:45.621860 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:15:45.621860 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:15:45.621860 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:15:45.621860 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52a25436-864d-4302-9b41-f9f904dfaa39 could not be found. Jul 05 16:15:45.621860 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:45.622950 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-15493be7-4ff1-4e65-8c00-be6d071af869 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Returning 404 to user: Instance 52a25436-864d-4302-9b41-f9f904dfaa39 could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:15:45.622950 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-15493be7-4ff1-4e65-8c00-be6d071af869 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39" status: 404 len: 111 microversion: 2.1 time: 0.028652 Jul 05 16:15:45.622950 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 448/887] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:15:45 2022] GET /compute/v2.1/servers/52a25436-864d-4302-9b41-f9f904dfaa39 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 16:15:46.891343 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-aa3cfb0b-accf-4d22-9d6e-79622f29e80c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:46.891927 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-aa3cfb0b-accf-4d22-9d6e-79622f29e80c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 1f42f67a-5eab-461d-9467-84aea8666852] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:46.899415 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-aa3cfb0b-accf-4d22-9d6e-79622f29e80c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:46.899869 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-aa3cfb0b-accf-4d22-9d6e-79622f29e80c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:46.900689 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-aa3cfb0b-accf-4d22-9d6e-79622f29e80c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:46.901111 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-aa3cfb0b-accf-4d22-9d6e-79622f29e80c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:46.917172 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-aa3cfb0b-accf-4d22-9d6e-79622f29e80c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] HTTP exception thrown: Instance 1f42f67a-5eab-461d-9467-84aea8666852 could not be found. Jul 05 16:15:46.917584 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-aa3cfb0b-accf-4d22-9d6e-79622f29e80c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Request method failure captured: Jul 05 16:15:46.917584 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: DELETE /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852 HTTP/1.1 Jul 05 16:15:46.917584 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:15:46.917584 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:15:46.917584 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:15:46.917584 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:15:46.917584 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:15:46.917584 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:15:46.917584 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:15:46.917584 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:15:46.917584 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIcG6oJHBbOiV-hRrdMXuy13iZZ6hvCfk-vTWz4vq2ula5Qwq5GKAKhC7pohxgL-mMXAkQ0I8c07z_L-klhBhC6mFKTl8PgxIghG2kxSHmXvGruMCHGJe1XXCXlDVgGJeXVlaQZZep4KSMSbhku1jx5l6fL00FOe6C27ag91K3fk98 Jul 05 16:15:46.917584 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:15:46.917584 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:15:46.917584 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:15:46.917584 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:15:46.917584 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:15:46.917584 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:15:46.917584 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 42e6ad67dbf542528726c545872ac10c Jul 05 16:15:46.917584 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:15:46.917584 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:15:46.917584 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:15:46.919021 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_42e6ad67dbf542528726c545872ac10c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:15:46.919021 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:15:46.919021 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 42e6ad67dbf542528726c545872ac10c Jul 05 16:15:46.919021 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:15:46.919021 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-AttachVolumeNegativeTest-547019280-project Jul 05 16:15:46.919021 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:15:46.919021 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:15:46.919021 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: 0c8512e7c1704fac9cc4fcfe3bf1f18b Jul 05 16:15:46.919021 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-AttachVolumeNegativeTest-547019280-project Jul 05 16:15:46.919021 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:15:46.919021 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance 1f42f67a-5eab-461d-9467-84aea8666852 could not be found. Jul 05 16:15:46.919021 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': '1f42f67a-5eab-461d-9467-84aea8666852'} Jul 05 16:15:46.919921 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:15:46.919921 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:46.919921 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:15:46.919921 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:15:46.919921 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:15:46.919921 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:15:46.919921 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:15:46.919921 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:15:46.919921 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:15:46.919921 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:15:46.919921 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f42f67a-5eab-461d-9467-84aea8666852 could not be found. Jul 05 16:15:46.919921 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:46.919921 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:15:46.919921 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:46.919921 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:46.919921 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:15:46.919921 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:15:46.919921 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:15:46.919921 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:15:46.919921 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:15:46.921490 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:15:46.921490 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 16:15:46.921490 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 16:15:46.921490 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 16:15:46.921490 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 16:15:46.921490 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:15:46.921490 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:15:46.921490 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:15:46.921490 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:15:46.921490 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f42f67a-5eab-461d-9467-84aea8666852 could not be found. Jul 05 16:15:46.921490 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:46.921490 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:15:46.921490 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:46.921490 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:46.921490 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:15:46.921490 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:15:46.921490 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:15:46.921490 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:15:46.921490 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f42f67a-5eab-461d-9467-84aea8666852 could not be found. Jul 05 16:15:46.921490 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:46.923890 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-aa3cfb0b-accf-4d22-9d6e-79622f29e80c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Returning 404 to user: Instance 1f42f67a-5eab-461d-9467-84aea8666852 could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:15:46.923890 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-aa3cfb0b-accf-4d22-9d6e-79622f29e80c tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852" status: 404 len: 111 microversion: 2.1 time: 0.032153 Jul 05 16:15:46.923890 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 449/888] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Jul 5 16:15:46 2022] DELETE /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 16:15:46.927669 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-05a9314c-e4ab-4540-a3fe-bb34a619449a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:46.928364 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-05a9314c-e4ab-4540-a3fe-bb34a619449a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 1f42f67a-5eab-461d-9467-84aea8666852] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:46.934048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-05a9314c-e4ab-4540-a3fe-bb34a619449a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:46.934492 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-05a9314c-e4ab-4540-a3fe-bb34a619449a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:46.935541 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-05a9314c-e4ab-4540-a3fe-bb34a619449a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:46.935976 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-05a9314c-e4ab-4540-a3fe-bb34a619449a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:46.950524 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-05a9314c-e4ab-4540-a3fe-bb34a619449a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] HTTP exception thrown: Instance 1f42f67a-5eab-461d-9467-84aea8666852 could not be found. Jul 05 16:15:46.952064 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-05a9314c-e4ab-4540-a3fe-bb34a619449a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Request method failure captured: Jul 05 16:15:46.952064 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852 HTTP/1.1 Jul 05 16:15:46.952064 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:15:46.952064 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:15:46.952064 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:15:46.952064 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:15:46.952064 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:15:46.952064 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:15:46.952064 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:15:46.952064 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:15:46.952064 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIcG6oJHBbOiV-hRrdMXuy13iZZ6hvCfk-vTWz4vq2ula5Qwq5GKAKhC7pohxgL-mMXAkQ0I8c07z_L-klhBhC6mFKTl8PgxIghG2kxSHmXvGruMCHGJe1XXCXlDVgGJeXVlaQZZep4KSMSbhku1jx5l6fL00FOe6C27ag91K3fk98 Jul 05 16:15:46.952064 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:15:46.952064 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:15:46.952064 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:15:46.952064 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:15:46.952064 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:15:46.952064 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:15:46.952064 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 42e6ad67dbf542528726c545872ac10c Jul 05 16:15:46.952064 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:15:46.952064 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:15:46.952064 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:15:46.953819 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_42e6ad67dbf542528726c545872ac10c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:15:46.953819 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:15:46.953819 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 42e6ad67dbf542528726c545872ac10c Jul 05 16:15:46.953819 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:15:46.953819 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-AttachVolumeNegativeTest-547019280-project Jul 05 16:15:46.953819 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:15:46.953819 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:15:46.953819 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: 0c8512e7c1704fac9cc4fcfe3bf1f18b Jul 05 16:15:46.953819 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-AttachVolumeNegativeTest-547019280-project Jul 05 16:15:46.953819 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:15:46.953819 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance 1f42f67a-5eab-461d-9467-84aea8666852 could not be found. Jul 05 16:15:46.953819 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': '1f42f67a-5eab-461d-9467-84aea8666852'} Jul 05 16:15:46.954703 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:15:46.954703 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:46.954703 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:15:46.954703 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:15:46.954703 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:15:46.954703 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:15:46.954703 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:15:46.954703 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:15:46.954703 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:15:46.954703 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:15:46.954703 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f42f67a-5eab-461d-9467-84aea8666852 could not be found. Jul 05 16:15:46.954703 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:46.954703 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:15:46.954703 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:46.954703 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:46.954703 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:15:46.954703 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:15:46.954703 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:15:46.954703 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:15:46.954703 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:15:46.956151 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:15:46.956151 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 16:15:46.956151 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 16:15:46.956151 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:15:46.956151 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:15:46.956151 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:15:46.956151 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:15:46.956151 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f42f67a-5eab-461d-9467-84aea8666852 could not be found. Jul 05 16:15:46.956151 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:46.956151 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:15:46.956151 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:46.956151 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:46.956151 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:15:46.956151 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:15:46.956151 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:15:46.956151 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:15:46.956151 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f42f67a-5eab-461d-9467-84aea8666852 could not be found. Jul 05 16:15:46.956151 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:46.957435 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-05a9314c-e4ab-4540-a3fe-bb34a619449a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Returning 404 to user: Instance 1f42f67a-5eab-461d-9467-84aea8666852 could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:15:46.957435 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-05a9314c-e4ab-4540-a3fe-bb34a619449a tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852" status: 404 len: 111 microversion: 2.1 time: 0.029972 Jul 05 16:15:46.957435 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 450/889] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:15:46 2022] GET /compute/v2.1/servers/1f42f67a-5eab-461d-9467-84aea8666852 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 16:15:46.961722 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-993b8f7a-1c79-42e5-8be2-8e9f095bc1f5 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:46.962212 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-993b8f7a-1c79-42e5-8be2-8e9f095bc1f5 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 82eccf63-469a-47ea-aab4-536d6210c066] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:46.967902 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-993b8f7a-1c79-42e5-8be2-8e9f095bc1f5 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:46.968364 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-993b8f7a-1c79-42e5-8be2-8e9f095bc1f5 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:46.969146 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-993b8f7a-1c79-42e5-8be2-8e9f095bc1f5 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:46.969573 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-993b8f7a-1c79-42e5-8be2-8e9f095bc1f5 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:46.982726 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-993b8f7a-1c79-42e5-8be2-8e9f095bc1f5 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] HTTP exception thrown: Instance 82eccf63-469a-47ea-aab4-536d6210c066 could not be found. Jul 05 16:15:46.984375 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-993b8f7a-1c79-42e5-8be2-8e9f095bc1f5 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Request method failure captured: Jul 05 16:15:46.984375 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: DELETE /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066 HTTP/1.1 Jul 05 16:15:46.984375 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:15:46.984375 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:15:46.984375 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:15:46.984375 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:15:46.984375 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:15:46.984375 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:15:46.984375 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:15:46.984375 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:15:46.984375 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIcG6oJHBbOiV-hRrdMXuy13iZZ6hvCfk-vTWz4vq2ula5Qwq5GKAKhC7pohxgL-mMXAkQ0I8c07z_L-klhBhC6mFKTl8PgxIghG2kxSHmXvGruMCHGJe1XXCXlDVgGJeXVlaQZZep4KSMSbhku1jx5l6fL00FOe6C27ag91K3fk98 Jul 05 16:15:46.984375 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:15:46.984375 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:15:46.984375 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:15:46.984375 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:15:46.984375 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:15:46.984375 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:15:46.984375 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 42e6ad67dbf542528726c545872ac10c Jul 05 16:15:46.984375 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:15:46.984375 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:15:46.984375 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:15:46.986237 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_42e6ad67dbf542528726c545872ac10c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:15:46.986237 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:15:46.986237 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 42e6ad67dbf542528726c545872ac10c Jul 05 16:15:46.986237 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:15:46.986237 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-AttachVolumeNegativeTest-547019280-project Jul 05 16:15:46.986237 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:15:46.986237 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:15:46.986237 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: 0c8512e7c1704fac9cc4fcfe3bf1f18b Jul 05 16:15:46.986237 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-AttachVolumeNegativeTest-547019280-project Jul 05 16:15:46.986237 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:15:46.986237 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance 82eccf63-469a-47ea-aab4-536d6210c066 could not be found. Jul 05 16:15:46.986237 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': '82eccf63-469a-47ea-aab4-536d6210c066'} Jul 05 16:15:46.987226 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:15:46.987226 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:46.987226 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:15:46.987226 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:15:46.987226 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:15:46.987226 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:15:46.987226 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:15:46.987226 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:15:46.987226 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:15:46.987226 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:15:46.987226 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82eccf63-469a-47ea-aab4-536d6210c066 could not be found. Jul 05 16:15:46.987226 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:46.987226 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:15:46.987226 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:46.987226 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:46.987226 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:15:46.987226 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:15:46.987226 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:15:46.987226 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:15:46.987226 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:15:46.988696 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:15:46.988696 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 16:15:46.988696 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 16:15:46.988696 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 16:15:46.988696 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 16:15:46.988696 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:15:46.988696 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:15:46.988696 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:15:46.988696 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:15:46.988696 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82eccf63-469a-47ea-aab4-536d6210c066 could not be found. Jul 05 16:15:46.988696 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:46.988696 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:15:46.988696 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:46.988696 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:46.988696 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:15:46.988696 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:15:46.988696 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:15:46.988696 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:15:46.988696 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82eccf63-469a-47ea-aab4-536d6210c066 could not be found. Jul 05 16:15:46.988696 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:46.990764 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-993b8f7a-1c79-42e5-8be2-8e9f095bc1f5 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Returning 404 to user: Instance 82eccf63-469a-47ea-aab4-536d6210c066 could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:15:46.990764 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-993b8f7a-1c79-42e5-8be2-8e9f095bc1f5 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "DELETE /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066" status: 404 len: 111 microversion: 2.1 time: 0.027945 Jul 05 16:15:46.990764 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 451/890] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Jul 5 16:15:46 2022] DELETE /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 16:15:46.994346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-9c4ac615-8a2c-45e0-bce9-7ae1afaf17a7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:47.003323 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-9c4ac615-8a2c-45e0-bce9-7ae1afaf17a7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 82eccf63-469a-47ea-aab4-536d6210c066] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:47.003323 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9c4ac615-8a2c-45e0-bce9-7ae1afaf17a7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:47.003323 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9c4ac615-8a2c-45e0-bce9-7ae1afaf17a7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:47.003323 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9c4ac615-8a2c-45e0-bce9-7ae1afaf17a7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:47.003677 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9c4ac615-8a2c-45e0-bce9-7ae1afaf17a7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:47.016724 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-9c4ac615-8a2c-45e0-bce9-7ae1afaf17a7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] HTTP exception thrown: Instance 82eccf63-469a-47ea-aab4-536d6210c066 could not be found. Jul 05 16:15:47.018229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-9c4ac615-8a2c-45e0-bce9-7ae1afaf17a7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Request method failure captured: Jul 05 16:15:47.018229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066 HTTP/1.1 Jul 05 16:15:47.018229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:15:47.018229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:15:47.018229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:15:47.018229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:15:47.018229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:15:47.018229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:15:47.018229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:15:47.018229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:15:47.018229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIcG6oJHBbOiV-hRrdMXuy13iZZ6hvCfk-vTWz4vq2ula5Qwq5GKAKhC7pohxgL-mMXAkQ0I8c07z_L-klhBhC6mFKTl8PgxIghG2kxSHmXvGruMCHGJe1XXCXlDVgGJeXVlaQZZep4KSMSbhku1jx5l6fL00FOe6C27ag91K3fk98 Jul 05 16:15:47.018229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:15:47.018229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:15:47.018229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:15:47.018229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:15:47.018229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:15:47.018229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:15:47.018229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 42e6ad67dbf542528726c545872ac10c Jul 05 16:15:47.018229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:15:47.018229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:15:47.018229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:15:47.019791 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_42e6ad67dbf542528726c545872ac10c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:15:47.019791 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:15:47.019791 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 42e6ad67dbf542528726c545872ac10c Jul 05 16:15:47.019791 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:15:47.019791 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-AttachVolumeNegativeTest-547019280-project Jul 05 16:15:47.019791 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:15:47.019791 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:15:47.019791 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: 0c8512e7c1704fac9cc4fcfe3bf1f18b Jul 05 16:15:47.019791 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-AttachVolumeNegativeTest-547019280-project Jul 05 16:15:47.019791 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:15:47.019791 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance 82eccf63-469a-47ea-aab4-536d6210c066 could not be found. Jul 05 16:15:47.019791 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': '82eccf63-469a-47ea-aab4-536d6210c066'} Jul 05 16:15:47.021168 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:15:47.021168 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:47.021168 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:15:47.021168 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:15:47.021168 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:15:47.021168 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:15:47.021168 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:15:47.021168 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:15:47.021168 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:15:47.021168 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:15:47.021168 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82eccf63-469a-47ea-aab4-536d6210c066 could not be found. Jul 05 16:15:47.021168 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:47.021168 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:15:47.021168 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:47.021168 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:47.021168 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:15:47.021168 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:15:47.021168 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:15:47.021168 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:15:47.021168 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:15:47.022891 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:15:47.022891 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 16:15:47.022891 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 16:15:47.022891 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:15:47.022891 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:15:47.022891 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:15:47.022891 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:15:47.022891 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82eccf63-469a-47ea-aab4-536d6210c066 could not be found. Jul 05 16:15:47.022891 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:47.022891 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:15:47.022891 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:47.022891 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:47.022891 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:15:47.022891 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:15:47.022891 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:15:47.022891 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:15:47.022891 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82eccf63-469a-47ea-aab4-536d6210c066 could not be found. Jul 05 16:15:47.022891 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:47.024175 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-9c4ac615-8a2c-45e0-bce9-7ae1afaf17a7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Returning 404 to user: Instance 82eccf63-469a-47ea-aab4-536d6210c066 could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:15:47.024175 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-9c4ac615-8a2c-45e0-bce9-7ae1afaf17a7 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066" status: 404 len: 111 microversion: 2.1 time: 0.028684 Jul 05 16:15:47.024175 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 452/891] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:15:46 2022] GET /compute/v2.1/servers/82eccf63-469a-47ea-aab4-536d6210c066 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 16:15:47.967318 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-2e6aa278-9b4e-4257-a227-010ac9421652 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:47.968239 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-2e6aa278-9b4e-4257-a227-010ac9421652 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:47.975306 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2e6aa278-9b4e-4257-a227-010ac9421652 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:47.975786 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2e6aa278-9b4e-4257-a227-010ac9421652 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:47.976524 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2e6aa278-9b4e-4257-a227-010ac9421652 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:47.976990 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2e6aa278-9b4e-4257-a227-010ac9421652 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:48.005008 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-2e6aa278-9b4e-4257-a227-010ac9421652 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041644 Jul 05 16:15:48.006293 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 453/892] 10.222.0.45 () {60 vars in 1342 bytes} [Tue Jul 5 16:15:47 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:15:48.068159 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-3bf518bc-033f-4f1a-bd71-f3c7829b03ce tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:48.069227 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-3bf518bc-033f-4f1a-bd71-f3c7829b03ce tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:48.075214 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3bf518bc-033f-4f1a-bd71-f3c7829b03ce tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:48.075669 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3bf518bc-033f-4f1a-bd71-f3c7829b03ce tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:48.076514 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3bf518bc-033f-4f1a-bd71-f3c7829b03ce tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:48.077048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3bf518bc-033f-4f1a-bd71-f3c7829b03ce tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:48.102247 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-3bf518bc-033f-4f1a-bd71-f3c7829b03ce tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Going to try to terminate instance {{(pid=118320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 16:15:48.384097 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-3bf518bc-033f-4f1a-bd71-f3c7829b03ce tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "DELETE /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 204 len: 0 microversion: 2.20 time: 0.319482 Jul 05 16:15:48.387837 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 454/893] 10.222.0.45 () {60 vars in 1279 bytes} [Tue Jul 5 16:15:48 2022] DELETE /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 05 16:15:48.390653 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-660253ca-f724-4997-8baa-e78eee1f87c6 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:48.391242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-660253ca-f724-4997-8baa-e78eee1f87c6 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:48.397761 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-660253ca-f724-4997-8baa-e78eee1f87c6 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:48.398313 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-660253ca-f724-4997-8baa-e78eee1f87c6 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:48.399159 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-660253ca-f724-4997-8baa-e78eee1f87c6 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:48.399600 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-660253ca-f724-4997-8baa-e78eee1f87c6 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:48.413146 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-660253ca-f724-4997-8baa-e78eee1f87c6 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] HTTP exception thrown: Instance 478dac11-75cf-4e58-9ba7-e78469b8045a could not be found. Jul 05 16:15:48.415119 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-660253ca-f724-4997-8baa-e78eee1f87c6 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Request method failure captured: Jul 05 16:15:48.415119 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: DELETE /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a HTTP/1.1 Jul 05 16:15:48.415119 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:15:48.415119 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:15:48.415119 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:15:48.415119 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:15:48.415119 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:15:48.415119 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:15:48.415119 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:15:48.415119 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:15:48.415119 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIcG6oJHBbOiV-hRrdMXuy13iZZ6hvCfk-vTWz4vq2ula5Qwq5GKAKhC7pohxgL-mMXAkQ0I8c07z_L-klhBhC6mFKTl8PgxIghG2kxSHmXvGruMCHGJe1XXCXlDVgGJeXVlaQZZep4KSMSbhku1jx5l6fL00FOe6C27ag91K3fk98 Jul 05 16:15:48.415119 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:15:48.415119 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:15:48.415119 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:15:48.415119 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:15:48.415119 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:15:48.415119 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:15:48.415119 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 42e6ad67dbf542528726c545872ac10c Jul 05 16:15:48.415119 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:15:48.415119 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:15:48.415119 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:15:48.416641 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_42e6ad67dbf542528726c545872ac10c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:15:48.416641 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:15:48.416641 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 42e6ad67dbf542528726c545872ac10c Jul 05 16:15:48.416641 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:15:48.416641 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-AttachVolumeNegativeTest-547019280-project Jul 05 16:15:48.416641 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:15:48.416641 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:15:48.416641 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: 0c8512e7c1704fac9cc4fcfe3bf1f18b Jul 05 16:15:48.416641 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-AttachVolumeNegativeTest-547019280-project Jul 05 16:15:48.416641 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:15:48.416641 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance 478dac11-75cf-4e58-9ba7-e78469b8045a could not be found. Jul 05 16:15:48.416641 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': '478dac11-75cf-4e58-9ba7-e78469b8045a'} Jul 05 16:15:48.420438 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:15:48.420438 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:48.420438 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:15:48.420438 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:15:48.420438 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:15:48.420438 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:15:48.420438 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:15:48.420438 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:15:48.420438 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:15:48.420438 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:15:48.420438 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 478dac11-75cf-4e58-9ba7-e78469b8045a could not be found. Jul 05 16:15:48.420438 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:48.420438 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:15:48.420438 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:48.420438 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:48.420438 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:15:48.420438 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:15:48.420438 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:15:48.420438 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:15:48.420438 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:15:48.421950 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:15:48.421950 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 16:15:48.421950 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 16:15:48.421950 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 16:15:48.421950 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 16:15:48.421950 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:15:48.421950 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:15:48.421950 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:15:48.421950 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:15:48.421950 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 478dac11-75cf-4e58-9ba7-e78469b8045a could not be found. Jul 05 16:15:48.421950 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:48.421950 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:15:48.421950 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:48.421950 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:48.421950 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:15:48.421950 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:15:48.421950 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:15:48.421950 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:15:48.421950 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 478dac11-75cf-4e58-9ba7-e78469b8045a could not be found. Jul 05 16:15:48.421950 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:48.423469 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-660253ca-f724-4997-8baa-e78eee1f87c6 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Returning 404 to user: Instance 478dac11-75cf-4e58-9ba7-e78469b8045a could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:15:48.423469 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-660253ca-f724-4997-8baa-e78eee1f87c6 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "DELETE /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 404 len: 111 microversion: 2.1 time: 0.030174 Jul 05 16:15:48.423469 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 455/894] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Jul 5 16:15:48 2022] DELETE /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 16:15:48.423469 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-dc3145ef-418d-4b42-8303-59999cdee015 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:48.423469 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-dc3145ef-418d-4b42-8303-59999cdee015 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:48.428887 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dc3145ef-418d-4b42-8303-59999cdee015 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:48.429335 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dc3145ef-418d-4b42-8303-59999cdee015 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:48.430090 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dc3145ef-418d-4b42-8303-59999cdee015 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:48.430521 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dc3145ef-418d-4b42-8303-59999cdee015 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:48.585802 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-dc3145ef-418d-4b42-8303-59999cdee015 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:48.593789 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-dc3145ef-418d-4b42-8303-59999cdee015 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:48.595371 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-dc3145ef-418d-4b42-8303-59999cdee015 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:48.596547 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-dc3145ef-418d-4b42-8303-59999cdee015 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1721 microversion: 2.20 time: 0.178306 Jul 05 16:15:48.597121 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 456/895] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:15:48 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:15:48.601539 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-d2bd5a8d-ff45-4684-98aa-b42cc422c523 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:48.602154 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-d2bd5a8d-ff45-4684-98aa-b42cc422c523 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] [instance: 478dac11-75cf-4e58-9ba7-e78469b8045a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:48.608184 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d2bd5a8d-ff45-4684-98aa-b42cc422c523 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:48.608641 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d2bd5a8d-ff45-4684-98aa-b42cc422c523 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:48.609449 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d2bd5a8d-ff45-4684-98aa-b42cc422c523 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:48.610158 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d2bd5a8d-ff45-4684-98aa-b42cc422c523 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:48.624234 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-d2bd5a8d-ff45-4684-98aa-b42cc422c523 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] HTTP exception thrown: Instance 478dac11-75cf-4e58-9ba7-e78469b8045a could not be found. Jul 05 16:15:48.629008 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-d2bd5a8d-ff45-4684-98aa-b42cc422c523 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Request method failure captured: Jul 05 16:15:48.629008 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a HTTP/1.1 Jul 05 16:15:48.629008 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:15:48.629008 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:15:48.629008 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:15:48.629008 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:15:48.629008 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:15:48.629008 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:15:48.629008 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:15:48.629008 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:15:48.629008 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIcG6oJHBbOiV-hRrdMXuy13iZZ6hvCfk-vTWz4vq2ula5Qwq5GKAKhC7pohxgL-mMXAkQ0I8c07z_L-klhBhC6mFKTl8PgxIghG2kxSHmXvGruMCHGJe1XXCXlDVgGJeXVlaQZZep4KSMSbhku1jx5l6fL00FOe6C27ag91K3fk98 Jul 05 16:15:48.629008 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:15:48.629008 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:15:48.629008 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:15:48.629008 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:15:48.629008 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:15:48.629008 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:15:48.629008 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 42e6ad67dbf542528726c545872ac10c Jul 05 16:15:48.629008 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:15:48.629008 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:15:48.629008 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:15:48.630307 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_42e6ad67dbf542528726c545872ac10c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42e6ad67dbf542528726c545872ac10c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:15:48.630307 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:15:48.630307 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 42e6ad67dbf542528726c545872ac10c Jul 05 16:15:48.630307 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-547019280 Jul 05 16:15:48.630307 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-AttachVolumeNegativeTest-547019280-project Jul 05 16:15:48.630307 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:15:48.630307 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:15:48.630307 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: 0c8512e7c1704fac9cc4fcfe3bf1f18b Jul 05 16:15:48.630307 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-AttachVolumeNegativeTest-547019280-project Jul 05 16:15:48.630307 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:15:48.630307 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance 478dac11-75cf-4e58-9ba7-e78469b8045a could not be found. Jul 05 16:15:48.630307 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': '478dac11-75cf-4e58-9ba7-e78469b8045a'} Jul 05 16:15:48.631692 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:15:48.631692 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:48.631692 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:15:48.631692 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:15:48.631692 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:15:48.631692 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:15:48.631692 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:15:48.631692 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:15:48.631692 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:15:48.631692 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:15:48.631692 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 478dac11-75cf-4e58-9ba7-e78469b8045a could not be found. Jul 05 16:15:48.631692 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:48.631692 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:15:48.631692 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:48.631692 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:48.631692 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:15:48.631692 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:15:48.631692 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:15:48.631692 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:15:48.631692 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:15:48.632888 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:15:48.632888 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 16:15:48.632888 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 16:15:48.632888 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:15:48.632888 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:15:48.632888 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:15:48.632888 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:15:48.632888 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 478dac11-75cf-4e58-9ba7-e78469b8045a could not be found. Jul 05 16:15:48.632888 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:48.632888 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:15:48.632888 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:48.632888 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:48.632888 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:15:48.632888 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:15:48.632888 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:15:48.632888 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:15:48.632888 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 478dac11-75cf-4e58-9ba7-e78469b8045a could not be found. Jul 05 16:15:48.632888 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:48.634381 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-d2bd5a8d-ff45-4684-98aa-b42cc422c523 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] Returning 404 to user: Instance 478dac11-75cf-4e58-9ba7-e78469b8045a could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:15:48.634381 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-d2bd5a8d-ff45-4684-98aa-b42cc422c523 tempest-AttachVolumeNegativeTest-547019280 tempest-AttachVolumeNegativeTest-547019280-project] 10.222.0.45 "GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a" status: 404 len: 111 microversion: 2.1 time: 0.029148 Jul 05 16:15:48.634381 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 457/896] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:15:48 2022] GET /compute/v2.1/servers/478dac11-75cf-4e58-9ba7-e78469b8045a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 16:15:49.615292 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-0a005e7f-55be-460c-b3f0-af2debdd0925 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:49.616876 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-0a005e7f-55be-460c-b3f0-af2debdd0925 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:49.628095 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0a005e7f-55be-460c-b3f0-af2debdd0925 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:49.631839 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0a005e7f-55be-460c-b3f0-af2debdd0925 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:49.632408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0a005e7f-55be-460c-b3f0-af2debdd0925 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:49.632903 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0a005e7f-55be-460c-b3f0-af2debdd0925 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:50.130049 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-0a005e7f-55be-460c-b3f0-af2debdd0925 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:50.139431 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-0a005e7f-55be-460c-b3f0-af2debdd0925 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:50.144589 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-0a005e7f-55be-460c-b3f0-af2debdd0925 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:50.147541 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-0a005e7f-55be-460c-b3f0-af2debdd0925 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1721 microversion: 2.20 time: 0.536266 Jul 05 16:15:50.154492 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 458/897] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:15:49 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1721 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 16:15:50.541304 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:15:50.561107 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: DEBUG dbcounter [-] [118319] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:15:51.165732 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-c24ca3b9-760b-4e28-9f31-5368a473a6a0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:51.166510 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-c24ca3b9-760b-4e28-9f31-5368a473a6a0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:51.173455 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c24ca3b9-760b-4e28-9f31-5368a473a6a0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:51.174052 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c24ca3b9-760b-4e28-9f31-5368a473a6a0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:51.174884 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c24ca3b9-760b-4e28-9f31-5368a473a6a0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:51.175637 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c24ca3b9-760b-4e28-9f31-5368a473a6a0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:51.571183 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c24ca3b9-760b-4e28-9f31-5368a473a6a0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:51.588117 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c24ca3b9-760b-4e28-9f31-5368a473a6a0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:51.588117 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c24ca3b9-760b-4e28-9f31-5368a473a6a0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0474d4e6dd4d2b9918fd0ebe803dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6acb89542314578839f701251add904', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:15:51.589111 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-c24ca3b9-760b-4e28-9f31-5368a473a6a0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 200 len: 1653 microversion: 2.20 time: 0.427331 Jul 05 16:15:51.590294 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 459/898] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:15:51 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 1653 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 16:15:51.762269 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-fa0c779f-3236-4c7d-87a0-04966f25e98d req-304c2485-da36-4684-a10b-19eee2cf1553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33b7b310-f555-460e-a187-4940bb9df69a", "name": "network-vif-deleted", "tag": "1ad3c6ce-99b9-4f8a-bbe2-1636e320f9ff"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:15:51.774111 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-fa0c779f-3236-4c7d-87a0-04966f25e98d req-304c2485-da36-4684-a10b-19eee2cf1553 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:51.776126 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-fa0c779f-3236-4c7d-87a0-04966f25e98d req-304c2485-da36-4684-a10b-19eee2cf1553 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:51.797460 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-fa0c779f-3236-4c7d-87a0-04966f25e98d req-304c2485-da36-4684-a10b-19eee2cf1553 service nova] Creating event network-vif-deleted:1ad3c6ce-99b9-4f8a-bbe2-1636e320f9ff for instance 33b7b310-f555-460e-a187-4940bb9df69a on hv-cinder-84875 Jul 05 16:15:51.805296 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-fa0c779f-3236-4c7d-87a0-04966f25e98d req-304c2485-da36-4684-a10b-19eee2cf1553 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049444 Jul 05 16:15:51.806848 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 460/899] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:15:52.609207 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-19f1a8c4-515a-41db-80f5-bfab9881eb85 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:52.610360 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-19f1a8c4-515a-41db-80f5-bfab9881eb85 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:52.618027 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-19f1a8c4-515a-41db-80f5-bfab9881eb85 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:52.618475 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-19f1a8c4-515a-41db-80f5-bfab9881eb85 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:52.623941 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-19f1a8c4-515a-41db-80f5-bfab9881eb85 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:52.623941 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-19f1a8c4-515a-41db-80f5-bfab9881eb85 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:52.634320 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-19f1a8c4-515a-41db-80f5-bfab9881eb85 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] HTTP exception thrown: Instance 33b7b310-f555-460e-a187-4940bb9df69a could not be found. Jul 05 16:15:52.635978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-19f1a8c4-515a-41db-80f5-bfab9881eb85 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Request method failure captured: Jul 05 16:15:52.635978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a HTTP/1.1 Jul 05 16:15:52.635978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:15:52.635978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:15:52.635978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:15:52.635978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:15:52.635978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:15:52.635978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:15:52.635978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:15:52.635978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:15:52.635978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIbAzY4m-xw6miW2z6yqGL3_GvI2FNll-taMsHI9kHnc86Pkz8VIEA_zUxPS0MvECalrA1RNhmZWNgqXenoHExZmV8MUlpjmawZTA-boICXZENJy2hmy1lMpn5SQ3TE_vrwTBcKictbAq5kkg2WOnUnoMgaHDurdYGKEt9-AUjkmjA Jul 05 16:15:52.635978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:15:52.635978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:15:52.635978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:15:52.635978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:15:52.635978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Openstack-Nova-Api-Version: 2.20 Jul 05 16:15:52.635978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:15:52.635978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:15:52.635978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: b6acb89542314578839f701251add904 Jul 05 16:15:52.635978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2020590602 Jul 05 16:15:52.635978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:15:52.635978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:15:52.637664 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b6acb89542314578839f701251add904"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b6acb89542314578839f701251add904"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b6acb89542314578839f701251add904"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b6acb89542314578839f701251add904"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:15:52.637664 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2020590602 Jul 05 16:15:52.637664 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: b6acb89542314578839f701251add904 Jul 05 16:15:52.637664 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2020590602 Jul 05 16:15:52.637664 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-AttachVolumeShelveTestJSON-2020590602-project Jul 05 16:15:52.637664 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:15:52.637664 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:15:52.637664 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: cb0474d4e6dd4d2b9918fd0ebe803dcd Jul 05 16:15:52.637664 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2020590602-project Jul 05 16:15:52.637664 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:15:52.637664 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance 33b7b310-f555-460e-a187-4940bb9df69a could not be found. Jul 05 16:15:52.637664 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': '33b7b310-f555-460e-a187-4940bb9df69a'} Jul 05 16:15:52.638554 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:15:52.638554 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:52.638554 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:15:52.638554 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:15:52.638554 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:15:52.638554 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:15:52.638554 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:15:52.638554 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:15:52.638554 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:15:52.638554 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:15:52.638554 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33b7b310-f555-460e-a187-4940bb9df69a could not be found. Jul 05 16:15:52.638554 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:52.638554 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:15:52.638554 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:52.638554 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:52.638554 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:15:52.638554 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:15:52.638554 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:15:52.638554 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:15:52.638554 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:15:52.639978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:15:52.639978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 16:15:52.639978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 16:15:52.639978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:15:52.639978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:15:52.639978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:15:52.639978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:15:52.639978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33b7b310-f555-460e-a187-4940bb9df69a could not be found. Jul 05 16:15:52.639978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:52.639978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:15:52.639978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:52.639978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:52.639978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:15:52.639978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:15:52.639978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:15:52.639978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:15:52.639978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33b7b310-f555-460e-a187-4940bb9df69a could not be found. Jul 05 16:15:52.639978 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:52.644089 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-19f1a8c4-515a-41db-80f5-bfab9881eb85 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Returning 404 to user: Instance 33b7b310-f555-460e-a187-4940bb9df69a could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:15:52.645436 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-19f1a8c4-515a-41db-80f5-bfab9881eb85 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 404 len: 111 microversion: 2.20 time: 0.041592 Jul 05 16:15:52.651834 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 461/900] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:15:52 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 05 16:15:52.655274 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-573dc8a0-362d-444a-ad78-7d2ceb183aa0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '.version_select at 0x7f3087c08a60>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:52.745375 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-573dc8a0-362d-444a-ad78-7d2ceb183aa0 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-600286819" status: 204 len: 0 microversion: 2.20 time: 0.094598 Jul 05 16:15:52.746264 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 462/901] 10.222.0.45 () {60 vars in 1258 bytes} [Tue Jul 5 16:15:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-600286819 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 05 16:15:55.522294 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-0d29ba2c-ca90-4520-a4e1-2a50cd06f276 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:55.522911 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-0d29ba2c-ca90-4520-a4e1-2a50cd06f276 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:55.531763 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0d29ba2c-ca90-4520-a4e1-2a50cd06f276 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:55.533339 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0d29ba2c-ca90-4520-a4e1-2a50cd06f276 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:55.534608 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0d29ba2c-ca90-4520-a4e1-2a50cd06f276 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:55.535120 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0d29ba2c-ca90-4520-a4e1-2a50cd06f276 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:55.549813 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-0d29ba2c-ca90-4520-a4e1-2a50cd06f276 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] HTTP exception thrown: Instance 33b7b310-f555-460e-a187-4940bb9df69a could not be found. Jul 05 16:15:55.551631 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-0d29ba2c-ca90-4520-a4e1-2a50cd06f276 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Request method failure captured: Jul 05 16:15:55.551631 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: DELETE /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a HTTP/1.1 Jul 05 16:15:55.551631 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:15:55.551631 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:15:55.551631 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:15:55.551631 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:15:55.551631 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:15:55.551631 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:15:55.551631 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:15:55.551631 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:15:55.551631 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIbAzY4m-xw6miW2z6yqGL3_GvI2FNll-taMsHI9kHnc86Pkz8VIEA_zUxPS0MvECalrA1RNhmZWNgqXenoHExZmV8MUlpjmawZTA-boICXZENJy2hmy1lMpn5SQ3TE_vrwTBcKictbAq5kkg2WOnUnoMgaHDurdYGKEt9-AUjkmjA Jul 05 16:15:55.551631 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:15:55.551631 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:15:55.551631 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:15:55.551631 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:15:55.551631 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Openstack-Nova-Api-Version: 2.20 Jul 05 16:15:55.551631 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:15:55.551631 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:15:55.551631 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: b6acb89542314578839f701251add904 Jul 05 16:15:55.551631 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2020590602 Jul 05 16:15:55.551631 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:15:55.551631 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:15:55.553959 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b6acb89542314578839f701251add904"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b6acb89542314578839f701251add904"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b6acb89542314578839f701251add904"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b6acb89542314578839f701251add904"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:15:55.553959 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2020590602 Jul 05 16:15:55.553959 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: b6acb89542314578839f701251add904 Jul 05 16:15:55.553959 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2020590602 Jul 05 16:15:55.553959 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-AttachVolumeShelveTestJSON-2020590602-project Jul 05 16:15:55.553959 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:15:55.553959 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:15:55.553959 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: cb0474d4e6dd4d2b9918fd0ebe803dcd Jul 05 16:15:55.553959 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2020590602-project Jul 05 16:15:55.553959 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:15:55.553959 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance 33b7b310-f555-460e-a187-4940bb9df69a could not be found. Jul 05 16:15:55.553959 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': '33b7b310-f555-460e-a187-4940bb9df69a'} Jul 05 16:15:55.555563 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:15:55.555563 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:55.555563 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:15:55.555563 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:15:55.555563 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:15:55.555563 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:15:55.555563 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:15:55.555563 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:15:55.555563 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:15:55.555563 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:15:55.555563 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33b7b310-f555-460e-a187-4940bb9df69a could not be found. Jul 05 16:15:55.555563 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:55.555563 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:15:55.555563 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:55.555563 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:55.555563 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:15:55.555563 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:15:55.555563 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:15:55.555563 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:15:55.555563 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:15:55.557254 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:15:55.557254 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 16:15:55.557254 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 16:15:55.557254 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 16:15:55.557254 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 16:15:55.557254 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:15:55.557254 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:15:55.557254 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:15:55.557254 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:15:55.557254 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33b7b310-f555-460e-a187-4940bb9df69a could not be found. Jul 05 16:15:55.557254 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:55.557254 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:15:55.557254 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:55.557254 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:55.557254 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:15:55.557254 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:15:55.557254 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:15:55.557254 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:15:55.557254 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33b7b310-f555-460e-a187-4940bb9df69a could not be found. Jul 05 16:15:55.557254 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:55.558792 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-0d29ba2c-ca90-4520-a4e1-2a50cd06f276 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Returning 404 to user: Instance 33b7b310-f555-460e-a187-4940bb9df69a could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:15:55.558792 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-0d29ba2c-ca90-4520-a4e1-2a50cd06f276 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "DELETE /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 404 len: 111 microversion: 2.20 time: 0.036118 Jul 05 16:15:55.558792 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 463/902] 10.222.0.45 () {60 vars in 1279 bytes} [Tue Jul 5 16:15:55 2022] DELETE /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 05 16:15:55.563066 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-20cbd532-9b8a-48a2-ae68-a61810e5bfe7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:55.563681 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-20cbd532-9b8a-48a2-ae68-a61810e5bfe7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: 33b7b310-f555-460e-a187-4940bb9df69a] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:55.570179 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-20cbd532-9b8a-48a2-ae68-a61810e5bfe7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:55.570815 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-20cbd532-9b8a-48a2-ae68-a61810e5bfe7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:55.571763 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-20cbd532-9b8a-48a2-ae68-a61810e5bfe7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:55.572197 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-20cbd532-9b8a-48a2-ae68-a61810e5bfe7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:55.576395 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:15:55.585442 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-20cbd532-9b8a-48a2-ae68-a61810e5bfe7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] HTTP exception thrown: Instance 33b7b310-f555-460e-a187-4940bb9df69a could not be found. Jul 05 16:15:55.587152 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-20cbd532-9b8a-48a2-ae68-a61810e5bfe7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Request method failure captured: Jul 05 16:15:55.587152 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a HTTP/1.1 Jul 05 16:15:55.587152 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:15:55.587152 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:15:55.587152 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:15:55.587152 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:15:55.587152 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:15:55.587152 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:15:55.587152 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:15:55.587152 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:15:55.587152 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIbAzY4m-xw6miW2z6yqGL3_GvI2FNll-taMsHI9kHnc86Pkz8VIEA_zUxPS0MvECalrA1RNhmZWNgqXenoHExZmV8MUlpjmawZTA-boICXZENJy2hmy1lMpn5SQ3TE_vrwTBcKictbAq5kkg2WOnUnoMgaHDurdYGKEt9-AUjkmjA Jul 05 16:15:55.587152 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:15:55.587152 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:15:55.587152 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:15:55.587152 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:15:55.587152 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Openstack-Nova-Api-Version: 2.20 Jul 05 16:15:55.587152 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:15:55.587152 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:15:55.587152 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: b6acb89542314578839f701251add904 Jul 05 16:15:55.587152 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2020590602 Jul 05 16:15:55.587152 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:15:55.587152 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:15:55.588711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b6acb89542314578839f701251add904"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b6acb89542314578839f701251add904"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b6acb89542314578839f701251add904"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b6acb89542314578839f701251add904"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:15:55.588711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2020590602 Jul 05 16:15:55.588711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: b6acb89542314578839f701251add904 Jul 05 16:15:55.588711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2020590602 Jul 05 16:15:55.588711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-AttachVolumeShelveTestJSON-2020590602-project Jul 05 16:15:55.588711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:15:55.588711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:15:55.588711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: cb0474d4e6dd4d2b9918fd0ebe803dcd Jul 05 16:15:55.588711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2020590602-project Jul 05 16:15:55.588711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:15:55.588711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance 33b7b310-f555-460e-a187-4940bb9df69a could not be found. Jul 05 16:15:55.588711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': '33b7b310-f555-460e-a187-4940bb9df69a'} Jul 05 16:15:55.589568 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:15:55.589568 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:55.589568 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:15:55.589568 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:15:55.589568 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:15:55.589568 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:15:55.589568 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:15:55.589568 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:15:55.589568 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:15:55.589568 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:15:55.589568 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33b7b310-f555-460e-a187-4940bb9df69a could not be found. Jul 05 16:15:55.589568 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:55.589568 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:15:55.589568 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:55.589568 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:55.589568 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:15:55.589568 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:15:55.589568 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:15:55.589568 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:15:55.589568 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:15:55.590900 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:15:55.590900 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 16:15:55.590900 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 16:15:55.590900 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:15:55.590900 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:15:55.590900 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:15:55.590900 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:15:55.590900 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33b7b310-f555-460e-a187-4940bb9df69a could not be found. Jul 05 16:15:55.590900 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:55.590900 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:15:55.590900 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:55.590900 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:55.590900 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:15:55.590900 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:15:55.590900 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:15:55.590900 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:15:55.590900 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33b7b310-f555-460e-a187-4940bb9df69a could not be found. Jul 05 16:15:55.590900 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:55.592743 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-20cbd532-9b8a-48a2-ae68-a61810e5bfe7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Returning 404 to user: Instance 33b7b310-f555-460e-a187-4940bb9df69a could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:15:55.593592 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-20cbd532-9b8a-48a2-ae68-a61810e5bfe7 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a" status: 404 len: 111 microversion: 2.20 time: 0.034520 Jul 05 16:15:55.594444 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 464/903] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:15:55 2022] GET /compute/v2.1/servers/33b7b310-f555-460e-a187-4940bb9df69a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 05 16:15:56.993041 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-51b35690-8e93-4986-b760-09a4ee5dc65f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:56.993614 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-51b35690-8e93-4986-b760-09a4ee5dc65f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:57.001849 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-51b35690-8e93-4986-b760-09a4ee5dc65f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:57.002894 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-51b35690-8e93-4986-b760-09a4ee5dc65f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:57.004009 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-51b35690-8e93-4986-b760-09a4ee5dc65f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:57.004903 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-51b35690-8e93-4986-b760-09a4ee5dc65f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:57.026491 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-51b35690-8e93-4986-b760-09a4ee5dc65f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] HTTP exception thrown: Instance da368d38-2642-49c3-b499-eb5a977cbd77 could not be found. Jul 05 16:15:57.029089 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-51b35690-8e93-4986-b760-09a4ee5dc65f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Request method failure captured: Jul 05 16:15:57.029089 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: DELETE /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 HTTP/1.1 Jul 05 16:15:57.029089 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:15:57.029089 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:15:57.029089 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:15:57.029089 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:15:57.029089 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:15:57.029089 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:15:57.029089 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:15:57.029089 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:15:57.029089 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIbAzY4m-xw6miW2z6yqGL3_GvI2FNll-taMsHI9kHnc86Pkz8VIEA_zUxPS0MvECalrA1RNhmZWNgqXenoHExZmV8MUlpjmawZTA-boICXZENJy2hmy1lMpn5SQ3TE_vrwTBcKictbAq5kkg2WOnUnoMgaHDurdYGKEt9-AUjkmjA Jul 05 16:15:57.029089 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:15:57.029089 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:15:57.029089 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:15:57.029089 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:15:57.029089 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Openstack-Nova-Api-Version: 2.20 Jul 05 16:15:57.029089 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:15:57.029089 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:15:57.029089 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: b6acb89542314578839f701251add904 Jul 05 16:15:57.029089 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2020590602 Jul 05 16:15:57.029089 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:15:57.029089 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:15:57.030679 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b6acb89542314578839f701251add904"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b6acb89542314578839f701251add904"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b6acb89542314578839f701251add904"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b6acb89542314578839f701251add904"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:15:57.030679 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2020590602 Jul 05 16:15:57.030679 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: b6acb89542314578839f701251add904 Jul 05 16:15:57.030679 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2020590602 Jul 05 16:15:57.030679 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-AttachVolumeShelveTestJSON-2020590602-project Jul 05 16:15:57.030679 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:15:57.030679 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:15:57.030679 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: cb0474d4e6dd4d2b9918fd0ebe803dcd Jul 05 16:15:57.030679 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2020590602-project Jul 05 16:15:57.030679 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:15:57.030679 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance da368d38-2642-49c3-b499-eb5a977cbd77 could not be found. Jul 05 16:15:57.030679 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': 'da368d38-2642-49c3-b499-eb5a977cbd77'} Jul 05 16:15:57.031459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:15:57.031459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:57.031459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:15:57.031459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:15:57.031459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:15:57.031459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:15:57.031459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:15:57.031459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:15:57.031459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:15:57.031459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:15:57.031459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da368d38-2642-49c3-b499-eb5a977cbd77 could not be found. Jul 05 16:15:57.031459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:57.031459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:15:57.031459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:57.031459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:57.031459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:15:57.031459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:15:57.031459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:15:57.031459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:15:57.031459 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:15:57.032665 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:15:57.032665 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 16:15:57.032665 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 16:15:57.032665 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 16:15:57.032665 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 16:15:57.032665 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:15:57.032665 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:15:57.032665 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:15:57.032665 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:15:57.032665 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da368d38-2642-49c3-b499-eb5a977cbd77 could not be found. Jul 05 16:15:57.032665 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:57.032665 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:15:57.032665 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:57.032665 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:57.032665 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:15:57.032665 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:15:57.032665 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:15:57.032665 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:15:57.032665 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da368d38-2642-49c3-b499-eb5a977cbd77 could not be found. Jul 05 16:15:57.032665 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:57.034785 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-51b35690-8e93-4986-b760-09a4ee5dc65f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Returning 404 to user: Instance da368d38-2642-49c3-b499-eb5a977cbd77 could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:15:57.035966 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-51b35690-8e93-4986-b760-09a4ee5dc65f tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "DELETE /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 404 len: 111 microversion: 2.20 time: 0.047470 Jul 05 16:15:57.036996 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 465/904] 10.222.0.45 () {60 vars in 1279 bytes} [Tue Jul 5 16:15:56 2022] DELETE /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 05 16:15:57.045961 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-89ab1dcb-b768-42d5-80ad-c497d663a626 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:15:57.047450 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-89ab1dcb-b768-42d5-80ad-c497d663a626 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] [instance: da368d38-2642-49c3-b499-eb5a977cbd77] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:15:57.054187 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-89ab1dcb-b768-42d5-80ad-c497d663a626 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:57.054650 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-89ab1dcb-b768-42d5-80ad-c497d663a626 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:57.055683 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-89ab1dcb-b768-42d5-80ad-c497d663a626 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:15:57.056131 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-89ab1dcb-b768-42d5-80ad-c497d663a626 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:15:57.073684 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-89ab1dcb-b768-42d5-80ad-c497d663a626 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] HTTP exception thrown: Instance da368d38-2642-49c3-b499-eb5a977cbd77 could not be found. Jul 05 16:15:57.076246 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-89ab1dcb-b768-42d5-80ad-c497d663a626 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Request method failure captured: Jul 05 16:15:57.076246 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 HTTP/1.1 Jul 05 16:15:57.076246 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:15:57.076246 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:15:57.076246 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:15:57.076246 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:15:57.076246 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:15:57.076246 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:15:57.076246 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:15:57.076246 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:15:57.076246 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIbAzY4m-xw6miW2z6yqGL3_GvI2FNll-taMsHI9kHnc86Pkz8VIEA_zUxPS0MvECalrA1RNhmZWNgqXenoHExZmV8MUlpjmawZTA-boICXZENJy2hmy1lMpn5SQ3TE_vrwTBcKictbAq5kkg2WOnUnoMgaHDurdYGKEt9-AUjkmjA Jul 05 16:15:57.076246 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:15:57.076246 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:15:57.076246 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:15:57.076246 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:15:57.076246 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Openstack-Nova-Api-Version: 2.20 Jul 05 16:15:57.076246 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:15:57.076246 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:15:57.076246 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: b6acb89542314578839f701251add904 Jul 05 16:15:57.076246 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2020590602 Jul 05 16:15:57.076246 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:15:57.076246 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:15:57.081550 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b6acb89542314578839f701251add904"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b6acb89542314578839f701251add904"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b6acb89542314578839f701251add904"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b6acb89542314578839f701251add904"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:15:57.081550 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2020590602 Jul 05 16:15:57.081550 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: b6acb89542314578839f701251add904 Jul 05 16:15:57.081550 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2020590602 Jul 05 16:15:57.081550 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-AttachVolumeShelveTestJSON-2020590602-project Jul 05 16:15:57.081550 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:15:57.081550 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:15:57.081550 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: cb0474d4e6dd4d2b9918fd0ebe803dcd Jul 05 16:15:57.081550 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2020590602-project Jul 05 16:15:57.081550 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:15:57.081550 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance da368d38-2642-49c3-b499-eb5a977cbd77 could not be found. Jul 05 16:15:57.081550 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': 'da368d38-2642-49c3-b499-eb5a977cbd77'} Jul 05 16:15:57.082345 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:15:57.082345 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:57.082345 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:15:57.082345 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:15:57.082345 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:15:57.082345 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:15:57.082345 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:15:57.082345 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:15:57.082345 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:15:57.082345 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:15:57.082345 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da368d38-2642-49c3-b499-eb5a977cbd77 could not be found. Jul 05 16:15:57.082345 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:57.082345 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:15:57.082345 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:57.082345 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:57.082345 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:15:57.082345 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:15:57.082345 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:15:57.082345 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:15:57.082345 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:15:57.084233 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:15:57.084233 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 16:15:57.084233 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 16:15:57.084233 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:15:57.084233 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:15:57.084233 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:15:57.084233 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:15:57.084233 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da368d38-2642-49c3-b499-eb5a977cbd77 could not be found. Jul 05 16:15:57.084233 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:57.084233 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:15:57.084233 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:57.084233 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:15:57.084233 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:15:57.084233 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:15:57.084233 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:15:57.084233 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:15:57.084233 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da368d38-2642-49c3-b499-eb5a977cbd77 could not be found. Jul 05 16:15:57.084233 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:15:57.085574 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-89ab1dcb-b768-42d5-80ad-c497d663a626 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] Returning 404 to user: Instance da368d38-2642-49c3-b499-eb5a977cbd77 could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:15:57.085574 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-89ab1dcb-b768-42d5-80ad-c497d663a626 tempest-AttachVolumeShelveTestJSON-2020590602 tempest-AttachVolumeShelveTestJSON-2020590602-project] 10.222.0.45 "GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77" status: 404 len: 111 microversion: 2.20 time: 0.038089 Jul 05 16:15:57.094156 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 466/905] 10.222.0.45 () {60 vars in 1276 bytes} [Tue Jul 5 16:15:57 2022] GET /compute/v2.1/servers/da368d38-2642-49c3-b499-eb5a977cbd77 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 05 16:16:04.281064 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-411e440e-7731-4f67-bbb2-557bb161b616 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Action: 'create', calling method: .version_select at 0x7f3087f29a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-2031343749", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhkeZrJu+1+gpHgo9HpW1RD5WrxWKUCBD90Mr99X2ID0lMFPq2XjWvomU3QqUOGSRUMWZEUjzD2if/jaMTVBClxMw8G9sWQzjD5unGl8Bnqumsz4SQTM/+/WTrW08IRZQ=="}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:16:04.315844 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-411e440e-7731-4f67-bbb2-557bb161b616 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Getting quotas for project de07093c553b4f0391c85e5ea04cf7f1. Resources: {'key_pairs'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:16:04.323262 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-411e440e-7731-4f67-bbb2-557bb161b616 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Getting quotas for user fe5390b9df9b445380119b995f4c457d and project de07093c553b4f0391c85e5ea04cf7f1. Resources: {'key_pairs'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:16:04.450984 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-411e440e-7731-4f67-bbb2-557bb161b616 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.419229 Jul 05 16:16:04.451815 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 467/906] 10.222.0.45 () {60 vars in 1158 bytes} [Tue Jul 5 16:16:04 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:16:22.957566 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=5 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:16:22.958344 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell0:SELECT=4 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:16:22.958987 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:16:22.962901 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-c80a22f1-cf7c-4b71-9fda-aa6d12dd45e8 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1080491920", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2031343749", "security_groups": [{"name": "tempest-secgroup-smoke-541061477"}], "networks": [{"uuid": "12affb1e-679a-48f8-ae30-8179cd00fc19"}], "block_device_mapping_v2": [{"uuid": "1df40eb8-309b-4d77-b753-d942ca43fea1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:16:23.075361 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.network.neutron [None req-c80a22f1-cf7c-4b71-9fda-aa6d12dd45e8 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] validate_networks() for [('12affb1e-679a-48f8-ae30-8179cd00fc19', None, None, None, None, None)] {{(pid=118320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 16:16:23.461297 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-c80a22f1-cf7c-4b71-9fda-aa6d12dd45e8 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Flavor limits 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 16:16:23.461722 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-c80a22f1-cf7c-4b71-9fda-aa6d12dd45e8 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Image limits 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 16:16:23.462524 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-c80a22f1-cf7c-4b71-9fda-aa6d12dd45e8 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Flavor pref 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 16:16:23.462947 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-c80a22f1-cf7c-4b71-9fda-aa6d12dd45e8 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Image pref 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 16:16:23.463367 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-c80a22f1-cf7c-4b71-9fda-aa6d12dd45e8 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 16:16:23.472686 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c80a22f1-cf7c-4b71-9fda-aa6d12dd45e8 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:23.473362 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c80a22f1-cf7c-4b71-9fda-aa6d12dd45e8 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:23.474767 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c80a22f1-cf7c-4b71-9fda-aa6d12dd45e8 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:23.475450 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c80a22f1-cf7c-4b71-9fda-aa6d12dd45e8 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:23.494510 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-c80a22f1-cf7c-4b71-9fda-aa6d12dd45e8 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Getting quotas for project de07093c553b4f0391c85e5ea04cf7f1. Resources: {'ram', 'instances', 'cores'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:16:23.498600 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-c80a22f1-cf7c-4b71-9fda-aa6d12dd45e8 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Getting quotas for user fe5390b9df9b445380119b995f4c457d and project de07093c553b4f0391c85e5ea04cf7f1. Resources: {'ram', 'instances', 'cores'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:16:23.559045 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-c80a22f1-cf7c-4b71-9fda-aa6d12dd45e8 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Going to run 1 instances... {{(pid=118320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 16:16:23.561295 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-c80a22f1-cf7c-4b71-9fda-aa6d12dd45e8 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1df40eb8-309b-4d77-b753-d942ca43fea1',volume_size=None,volume_type=None)] {{(pid=118320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 16:16:24.066042 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-c80a22f1-cf7c-4b71-9fda-aa6d12dd45e8 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.109740 Jul 05 16:16:24.066846 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 468/907] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Jul 5 16:16:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 1111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 05 16:16:24.076302 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-bac5607a-47ad-4852-8079-2a94cc50a7d3 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:16:24.077204 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-bac5607a-47ad-4852-8079-2a94cc50a7d3 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:16:24.133746 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-bac5607a-47ad-4852-8079-2a94cc50a7d3 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:16:24.142464 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-bac5607a-47ad-4852-8079-2a94cc50a7d3 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1089 microversion: 2.1 time: 0.069733 Jul 05 16:16:24.143035 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 469/908] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:16:24 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1089 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:16:25.160539 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-3b7d5a37-0d9c-4b39-8c41-48d17f23d933 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:16:25.162035 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-3b7d5a37-0d9c-4b39-8c41-48d17f23d933 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:16:25.169837 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3b7d5a37-0d9c-4b39-8c41-48d17f23d933 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:25.170292 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3b7d5a37-0d9c-4b39-8c41-48d17f23d933 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:25.171075 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3b7d5a37-0d9c-4b39-8c41-48d17f23d933 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:25.171516 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3b7d5a37-0d9c-4b39-8c41-48d17f23d933 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:25.233257 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-3b7d5a37-0d9c-4b39-8c41-48d17f23d933 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:16:25.242143 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-3b7d5a37-0d9c-4b39-8c41-48d17f23d933 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1139 microversion: 2.1 time: 0.086434 Jul 05 16:16:25.242707 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 470/909] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:16:25 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1139 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:16:26.260438 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-c4352746-872d-40b8-98a3-3c5ed878d8d2 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:16:26.261745 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-c4352746-872d-40b8-98a3-3c5ed878d8d2 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:16:26.268613 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c4352746-872d-40b8-98a3-3c5ed878d8d2 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:26.269511 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c4352746-872d-40b8-98a3-3c5ed878d8d2 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:26.271731 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c4352746-872d-40b8-98a3-3c5ed878d8d2 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:26.272453 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c4352746-872d-40b8-98a3-3c5ed878d8d2 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:26.368746 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c4352746-872d-40b8-98a3-3c5ed878d8d2 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:16:26.380340 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-c4352746-872d-40b8-98a3-3c5ed878d8d2 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1195 microversion: 2.1 time: 0.124656 Jul 05 16:16:26.381484 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 471/910] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:16:26 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1195 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:16:27.397831 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-b3b36f4d-b484-4e9f-abd9-69dfc8ac79f0 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:16:27.398470 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-b3b36f4d-b484-4e9f-abd9-69dfc8ac79f0 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:16:27.406625 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b3b36f4d-b484-4e9f-abd9-69dfc8ac79f0 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:27.408063 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b3b36f4d-b484-4e9f-abd9-69dfc8ac79f0 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:27.408901 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b3b36f4d-b484-4e9f-abd9-69dfc8ac79f0 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:27.409353 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b3b36f4d-b484-4e9f-abd9-69dfc8ac79f0 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:27.684180 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-b3b36f4d-b484-4e9f-abd9-69dfc8ac79f0 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:16:27.699336 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-b3b36f4d-b484-4e9f-abd9-69dfc8ac79f0 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1272 microversion: 2.1 time: 0.305397 Jul 05 16:16:27.709344 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 472/911] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:16:27 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1272 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:16:28.328834 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-9206b71d-c211-450a-9a46-13a6d11b1b9a req-13b1e98b-9940-4449-b84e-6d7aa8be6c4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0e15bb7-d358-439f-b3bc-697f5c8ee180", "tag": "f472f8e8-76d0-4068-af84-5901b45f5f21"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:16:28.338919 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-9206b71d-c211-450a-9a46-13a6d11b1b9a req-13b1e98b-9940-4449-b84e-6d7aa8be6c4b service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:28.345693 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-9206b71d-c211-450a-9a46-13a6d11b1b9a req-13b1e98b-9940-4449-b84e-6d7aa8be6c4b service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:28.353394 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-9206b71d-c211-450a-9a46-13a6d11b1b9a req-13b1e98b-9940-4449-b84e-6d7aa8be6c4b service nova] Creating event network-changed:f472f8e8-76d0-4068-af84-5901b45f5f21 for instance c0e15bb7-d358-439f-b3bc-697f5c8ee180 on hv-cinder-84875 Jul 05 16:16:28.359123 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-9206b71d-c211-450a-9a46-13a6d11b1b9a req-13b1e98b-9940-4449-b84e-6d7aa8be6c4b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034063 Jul 05 16:16:28.360205 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 473/912] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:16:28.717508 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-441708a6-4502-4754-be07-713c8bbd7f44 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:16:28.718227 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-441708a6-4502-4754-be07-713c8bbd7f44 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:16:28.725881 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-441708a6-4502-4754-be07-713c8bbd7f44 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:28.726340 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-441708a6-4502-4754-be07-713c8bbd7f44 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:28.727191 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-441708a6-4502-4754-be07-713c8bbd7f44 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:28.727637 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-441708a6-4502-4754-be07-713c8bbd7f44 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:28.962685 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-441708a6-4502-4754-be07-713c8bbd7f44 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:16:28.975073 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-441708a6-4502-4754-be07-713c8bbd7f44 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1260 microversion: 2.1 time: 0.261795 Jul 05 16:16:28.975660 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 474/913] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:16:28 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1260 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:16:29.991937 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-0617cc1f-a286-42c4-b7d6-c5d37aa3fbef tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:16:29.992628 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-0617cc1f-a286-42c4-b7d6-c5d37aa3fbef tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:16:29.999101 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0617cc1f-a286-42c4-b7d6-c5d37aa3fbef tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:29.999547 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0617cc1f-a286-42c4-b7d6-c5d37aa3fbef tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:30.000302 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0617cc1f-a286-42c4-b7d6-c5d37aa3fbef tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:30.000735 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0617cc1f-a286-42c4-b7d6-c5d37aa3fbef tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:30.134170 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-0617cc1f-a286-42c4-b7d6-c5d37aa3fbef tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:16:30.141726 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-0617cc1f-a286-42c4-b7d6-c5d37aa3fbef tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1260 microversion: 2.1 time: 0.154333 Jul 05 16:16:30.142333 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 475/914] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:16:29 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:16:31.158824 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-93265bb2-cd9a-4a02-96d5-bdf56f1f887e tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:16:31.159449 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-93265bb2-cd9a-4a02-96d5-bdf56f1f887e tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:16:31.166620 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-93265bb2-cd9a-4a02-96d5-bdf56f1f887e tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:31.167127 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-93265bb2-cd9a-4a02-96d5-bdf56f1f887e tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:31.167913 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-93265bb2-cd9a-4a02-96d5-bdf56f1f887e tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:31.168334 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-93265bb2-cd9a-4a02-96d5-bdf56f1f887e tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:31.297697 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-93265bb2-cd9a-4a02-96d5-bdf56f1f887e tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:16:31.305330 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-93265bb2-cd9a-4a02-96d5-bdf56f1f887e tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1260 microversion: 2.1 time: 0.150628 Jul 05 16:16:31.305901 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 476/915] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:16:31 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:16:32.322679 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-7e880dcf-2777-4ca1-a2ef-c65693c5c4f4 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:16:32.323364 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-7e880dcf-2777-4ca1-a2ef-c65693c5c4f4 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:16:32.329930 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7e880dcf-2777-4ca1-a2ef-c65693c5c4f4 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:32.330387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7e880dcf-2777-4ca1-a2ef-c65693c5c4f4 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:32.331157 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7e880dcf-2777-4ca1-a2ef-c65693c5c4f4 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:32.331697 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7e880dcf-2777-4ca1-a2ef-c65693c5c4f4 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:32.467467 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-7e880dcf-2777-4ca1-a2ef-c65693c5c4f4 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:16:32.475454 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-7e880dcf-2777-4ca1-a2ef-c65693c5c4f4 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1260 microversion: 2.1 time: 0.157032 Jul 05 16:16:32.476021 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 477/916] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:16:32 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:16:33.492230 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-376ac227-5161-4dc7-9259-e9eed170a078 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:16:33.492912 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-376ac227-5161-4dc7-9259-e9eed170a078 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:16:33.495401 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell0:SELECT=2 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:16:33.500304 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-376ac227-5161-4dc7-9259-e9eed170a078 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:33.500808 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-376ac227-5161-4dc7-9259-e9eed170a078 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:33.501758 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-376ac227-5161-4dc7-9259-e9eed170a078 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:33.502197 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-376ac227-5161-4dc7-9259-e9eed170a078 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:33.664750 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-376ac227-5161-4dc7-9259-e9eed170a078 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:16:33.672123 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-376ac227-5161-4dc7-9259-e9eed170a078 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1260 microversion: 2.1 time: 0.184251 Jul 05 16:16:33.674965 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 478/917] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:16:33 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:16:34.690512 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-0d7c2300-6328-4dd5-9e9f-a18c9c928818 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:16:34.690512 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-0d7c2300-6328-4dd5-9e9f-a18c9c928818 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:16:34.691501 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell0:SELECT=8 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:16:34.697324 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0d7c2300-6328-4dd5-9e9f-a18c9c928818 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:34.697784 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0d7c2300-6328-4dd5-9e9f-a18c9c928818 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:34.698542 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0d7c2300-6328-4dd5-9e9f-a18c9c928818 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:34.698975 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0d7c2300-6328-4dd5-9e9f-a18c9c928818 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:34.882628 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-0d7c2300-6328-4dd5-9e9f-a18c9c928818 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:16:34.891402 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-0d7c2300-6328-4dd5-9e9f-a18c9c928818 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1260 microversion: 2.1 time: 0.205742 Jul 05 16:16:34.901742 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 479/918] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:16:34 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1260 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:16:35.909589 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-e8f5da69-1b2c-40d7-89dd-80f1d1bfc06c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:16:35.910682 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-e8f5da69-1b2c-40d7-89dd-80f1d1bfc06c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:16:35.918441 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e8f5da69-1b2c-40d7-89dd-80f1d1bfc06c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:35.919151 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e8f5da69-1b2c-40d7-89dd-80f1d1bfc06c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:35.920022 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e8f5da69-1b2c-40d7-89dd-80f1d1bfc06c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:35.920567 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e8f5da69-1b2c-40d7-89dd-80f1d1bfc06c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:36.056904 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-e8f5da69-1b2c-40d7-89dd-80f1d1bfc06c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:16:36.070254 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-e8f5da69-1b2c-40d7-89dd-80f1d1bfc06c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1260 microversion: 2.1 time: 0.164598 Jul 05 16:16:36.071140 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 480/919] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:16:35 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:16:37.087057 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-a96bc4da-c832-447a-b402-0719788267e4 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:16:37.087755 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-a96bc4da-c832-447a-b402-0719788267e4 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:16:37.094374 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a96bc4da-c832-447a-b402-0719788267e4 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:37.094922 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a96bc4da-c832-447a-b402-0719788267e4 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:37.095789 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a96bc4da-c832-447a-b402-0719788267e4 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:37.096480 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a96bc4da-c832-447a-b402-0719788267e4 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:37.255980 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-a96bc4da-c832-447a-b402-0719788267e4 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:16:37.263529 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-a96bc4da-c832-447a-b402-0719788267e4 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1260 microversion: 2.1 time: 0.180854 Jul 05 16:16:37.264095 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 481/920] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:16:37 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:16:38.281488 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-a5c547eb-9971-4679-98f6-dbd3df0805f1 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:16:38.282326 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-a5c547eb-9971-4679-98f6-dbd3df0805f1 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:16:38.289070 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a5c547eb-9971-4679-98f6-dbd3df0805f1 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:38.289768 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a5c547eb-9971-4679-98f6-dbd3df0805f1 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:38.290554 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a5c547eb-9971-4679-98f6-dbd3df0805f1 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:38.290997 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a5c547eb-9971-4679-98f6-dbd3df0805f1 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:38.430329 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-a5c547eb-9971-4679-98f6-dbd3df0805f1 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:16:38.437927 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-a5c547eb-9971-4679-98f6-dbd3df0805f1 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1260 microversion: 2.1 time: 0.160653 Jul 05 16:16:38.438498 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 482/921] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:16:38 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:16:38.960895 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-de4c7b27-e313-447b-b284-4ffa92ac74d1 req-c9876f21-ff53-4f69-a3f5-7e7d006d600b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e15bb7-d358-439f-b3bc-697f5c8ee180", "name": "network-vif-plugged", "status": "completed", "tag": "f472f8e8-76d0-4068-af84-5901b45f5f21"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:16:38.971033 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-de4c7b27-e313-447b-b284-4ffa92ac74d1 req-c9876f21-ff53-4f69-a3f5-7e7d006d600b service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:38.971466 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-de4c7b27-e313-447b-b284-4ffa92ac74d1 req-c9876f21-ff53-4f69-a3f5-7e7d006d600b service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:38.982339 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-de4c7b27-e313-447b-b284-4ffa92ac74d1 req-c9876f21-ff53-4f69-a3f5-7e7d006d600b service nova] Creating event network-vif-plugged:f472f8e8-76d0-4068-af84-5901b45f5f21 for instance c0e15bb7-d358-439f-b3bc-697f5c8ee180 on hv-cinder-84875 Jul 05 16:16:38.987497 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-de4c7b27-e313-447b-b284-4ffa92ac74d1 req-c9876f21-ff53-4f69-a3f5-7e7d006d600b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031662 Jul 05 16:16:38.988266 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 483/922] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:16:39.456608 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-6d7dd3bf-662a-478b-bb07-aa2b907eb246 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:16:39.457360 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-6d7dd3bf-662a-478b-bb07-aa2b907eb246 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:16:39.464467 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6d7dd3bf-662a-478b-bb07-aa2b907eb246 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:39.464958 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6d7dd3bf-662a-478b-bb07-aa2b907eb246 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:39.465738 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6d7dd3bf-662a-478b-bb07-aa2b907eb246 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:39.466183 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6d7dd3bf-662a-478b-bb07-aa2b907eb246 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:39.611282 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-6d7dd3bf-662a-478b-bb07-aa2b907eb246 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:16:39.621286 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-6d7dd3bf-662a-478b-bb07-aa2b907eb246 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1260 microversion: 2.1 time: 0.169188 Jul 05 16:16:39.621864 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 484/923] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:16:39 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:16:40.638934 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-0fe12cf4-90dc-4a1b-8c08-6e6663ad58ef tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:16:40.639795 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-0fe12cf4-90dc-4a1b-8c08-6e6663ad58ef tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:16:40.649654 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0fe12cf4-90dc-4a1b-8c08-6e6663ad58ef tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:40.650108 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0fe12cf4-90dc-4a1b-8c08-6e6663ad58ef tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:40.650929 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0fe12cf4-90dc-4a1b-8c08-6e6663ad58ef tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:40.651363 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0fe12cf4-90dc-4a1b-8c08-6e6663ad58ef tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:40.788506 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-0fe12cf4-90dc-4a1b-8c08-6e6663ad58ef tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:16:40.796150 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-0fe12cf4-90dc-4a1b-8c08-6e6663ad58ef tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1444 microversion: 2.1 time: 0.161142 Jul 05 16:16:40.796630 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 485/924] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:16:40 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1444 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:16:40.801030 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-d0f76f91-2c74-40ea-afbd-0ee6d8a20387 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:16:40.801633 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-d0f76f91-2c74-40ea-afbd-0ee6d8a20387 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:16:40.807740 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d0f76f91-2c74-40ea-afbd-0ee6d8a20387 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:40.808255 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d0f76f91-2c74-40ea-afbd-0ee6d8a20387 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:40.813884 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d0f76f91-2c74-40ea-afbd-0ee6d8a20387 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:40.813884 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d0f76f91-2c74-40ea-afbd-0ee6d8a20387 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:40.824672 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-d0f76f91-2c74-40ea-afbd-0ee6d8a20387 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] HTTP exception thrown: Instance c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 could not be found. Jul 05 16:16:40.826453 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-d0f76f91-2c74-40ea-afbd-0ee6d8a20387 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Request method failure captured: Jul 05 16:16:40.826453 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 HTTP/1.1 Jul 05 16:16:40.826453 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:16:40.826453 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:16:40.826453 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:16:40.826453 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:16:40.826453 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:16:40.826453 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:16:40.826453 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:16:40.826453 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:16:40.826453 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIXkYoYC5OUwlwwwcN4lQebGZCDv39VJouOlBDL-ZM0IwO2NZWFjFw3CBRHJ9oZWGpw0SIJHD_3yUkxhSGoEoZ2f5SafYhKjPNSYWjCCpBNrrOpFH3EzbYoOd1JFjSWmJwf_VIM07567DnvlGW6gjYXvlrQcYGemTNCHBf3LVZpT4s Jul 05 16:16:40.826453 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:16:40.826453 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:16:40.826453 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:16:40.826453 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:16:40.826453 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:16:40.826453 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:16:40.826453 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 3ec37a457530439b8728dd2ad2b6b7bd Jul 05 16:16:40.826453 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-AttachVolumeTestJSON-187031460 Jul 05 16:16:40.826453 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:16:40.826453 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:16:40.828145 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3ec37a457530439b8728dd2ad2b6b7bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3ec37a457530439b8728dd2ad2b6b7bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3ec37a457530439b8728dd2ad2b6b7bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3ec37a457530439b8728dd2ad2b6b7bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:16:40.828145 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-AttachVolumeTestJSON-187031460 Jul 05 16:16:40.828145 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 3ec37a457530439b8728dd2ad2b6b7bd Jul 05 16:16:40.828145 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-AttachVolumeTestJSON-187031460 Jul 05 16:16:40.828145 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-AttachVolumeTestJSON-187031460-project Jul 05 16:16:40.828145 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:16:40.828145 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:16:40.828145 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: d7e2fc1ec676438392d7925b43b806f5 Jul 05 16:16:40.828145 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-AttachVolumeTestJSON-187031460-project Jul 05 16:16:40.828145 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:16:40.828145 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 could not be found. Jul 05 16:16:40.828145 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': 'c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66'} Jul 05 16:16:40.829125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:16:40.829125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:16:40.829125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:16:40.829125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:16:40.829125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:16:40.829125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:16:40.829125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:16:40.829125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:16:40.829125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:16:40.829125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:16:40.829125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 could not be found. Jul 05 16:16:40.829125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:16:40.829125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:16:40.829125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:16:40.829125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:16:40.829125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:16:40.829125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:16:40.829125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:16:40.829125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:16:40.829125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:16:40.830827 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:16:40.830827 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 16:16:40.830827 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 16:16:40.830827 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:16:40.830827 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:16:40.830827 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:16:40.830827 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:16:40.830827 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 could not be found. Jul 05 16:16:40.830827 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:16:40.830827 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:16:40.830827 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:16:40.830827 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:16:40.830827 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:16:40.830827 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:16:40.830827 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:16:40.830827 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:16:40.830827 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 could not be found. Jul 05 16:16:40.830827 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:16:40.832076 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-d0f76f91-2c74-40ea-afbd-0ee6d8a20387 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Returning 404 to user: Instance c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:16:40.832076 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-d0f76f91-2c74-40ea-afbd-0ee6d8a20387 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66" status: 404 len: 111 microversion: 2.1 time: 0.030344 Jul 05 16:16:40.832076 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 486/925] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:16:40 2022] GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 16:16:40.833679 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-698cdbf1-78d9-476f-97ae-5579ddbc64ca tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:16:40.834335 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-698cdbf1-78d9-476f-97ae-5579ddbc64ca tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:16:40.840065 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-698cdbf1-78d9-476f-97ae-5579ddbc64ca tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:40.842629 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-698cdbf1-78d9-476f-97ae-5579ddbc64ca tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:40.842629 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-698cdbf1-78d9-476f-97ae-5579ddbc64ca tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:40.842629 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-698cdbf1-78d9-476f-97ae-5579ddbc64ca tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:41.206832 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-698cdbf1-78d9-476f-97ae-5579ddbc64ca tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:16:41.215075 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-698cdbf1-78d9-476f-97ae-5579ddbc64ca tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1444 microversion: 2.1 time: 0.385227 Jul 05 16:16:41.215681 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 487/926] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:16:40 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1444 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:16:41.220231 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-deb323b8-2a90-4c58-ac1b-fee949e365fd tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '.version_select at 0x7f30942b7e50>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:16:41.293713 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-deb323b8-2a90-4c58-ac1b-fee949e365fd tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2022313536" status: 202 len: 0 microversion: 2.1 time: 0.076844 Jul 05 16:16:41.294571 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 488/927] 10.222.0.45 () {58 vars in 1220 bytes} [Tue Jul 5 16:16:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2022313536 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 16:16:43.592589 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-01b456c9-b297-4f02-a7fa-588f7d16d25a req-6ab58ef6-4837-459c-9ad9-82a05ac7d7c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0e15bb7-d358-439f-b3bc-697f5c8ee180", "tag": "f472f8e8-76d0-4068-af84-5901b45f5f21"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:16:43.601164 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-01b456c9-b297-4f02-a7fa-588f7d16d25a req-6ab58ef6-4837-459c-9ad9-82a05ac7d7c9 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:43.601609 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-01b456c9-b297-4f02-a7fa-588f7d16d25a req-6ab58ef6-4837-459c-9ad9-82a05ac7d7c9 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:43.605452 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=100 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:16:43.612931 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-01b456c9-b297-4f02-a7fa-588f7d16d25a req-6ab58ef6-4837-459c-9ad9-82a05ac7d7c9 service nova] Creating event network-changed:f472f8e8-76d0-4068-af84-5901b45f5f21 for instance c0e15bb7-d358-439f-b3bc-697f5c8ee180 on hv-cinder-84875 Jul 05 16:16:43.618585 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-01b456c9-b297-4f02-a7fa-588f7d16d25a req-6ab58ef6-4837-459c-9ad9-82a05ac7d7c9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030324 Jul 05 16:16:43.619542 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 489/928] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:16:44.708805 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-ff23eb10-896f-44a6-a849-a5774069eea0 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:16:44.710308 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-ff23eb10-896f-44a6-a849-a5774069eea0 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:16:44.717710 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ff23eb10-896f-44a6-a849-a5774069eea0 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:44.718969 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ff23eb10-896f-44a6-a849-a5774069eea0 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:44.718969 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ff23eb10-896f-44a6-a849-a5774069eea0 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:44.719490 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ff23eb10-896f-44a6-a849-a5774069eea0 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:44.734570 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-ff23eb10-896f-44a6-a849-a5774069eea0 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] HTTP exception thrown: Instance c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 could not be found. Jul 05 16:16:44.736615 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-ff23eb10-896f-44a6-a849-a5774069eea0 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Request method failure captured: Jul 05 16:16:44.736615 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: DELETE /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 HTTP/1.1 Jul 05 16:16:44.736615 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:16:44.736615 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:16:44.736615 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:16:44.736615 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:16:44.736615 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:16:44.736615 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:16:44.736615 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:16:44.736615 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:16:44.736615 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIXkYoYC5OUwlwwwcN4lQebGZCDv39VJouOlBDL-ZM0IwO2NZWFjFw3CBRHJ9oZWGpw0SIJHD_3yUkxhSGoEoZ2f5SafYhKjPNSYWjCCpBNrrOpFH3EzbYoOd1JFjSWmJwf_VIM07567DnvlGW6gjYXvlrQcYGemTNCHBf3LVZpT4s Jul 05 16:16:44.736615 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:16:44.736615 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:16:44.736615 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:16:44.736615 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:16:44.736615 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:16:44.736615 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:16:44.736615 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 3ec37a457530439b8728dd2ad2b6b7bd Jul 05 16:16:44.736615 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-AttachVolumeTestJSON-187031460 Jul 05 16:16:44.736615 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:16:44.736615 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:16:44.738529 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3ec37a457530439b8728dd2ad2b6b7bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3ec37a457530439b8728dd2ad2b6b7bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3ec37a457530439b8728dd2ad2b6b7bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3ec37a457530439b8728dd2ad2b6b7bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:16:44.738529 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-AttachVolumeTestJSON-187031460 Jul 05 16:16:44.738529 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 3ec37a457530439b8728dd2ad2b6b7bd Jul 05 16:16:44.738529 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-AttachVolumeTestJSON-187031460 Jul 05 16:16:44.738529 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-AttachVolumeTestJSON-187031460-project Jul 05 16:16:44.738529 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:16:44.738529 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:16:44.738529 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: d7e2fc1ec676438392d7925b43b806f5 Jul 05 16:16:44.738529 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-AttachVolumeTestJSON-187031460-project Jul 05 16:16:44.738529 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:16:44.738529 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 could not be found. Jul 05 16:16:44.738529 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': 'c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66'} Jul 05 16:16:44.743824 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:16:44.743824 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:16:44.743824 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:16:44.743824 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:16:44.743824 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:16:44.743824 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:16:44.743824 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:16:44.743824 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:16:44.743824 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:16:44.743824 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:16:44.743824 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 could not be found. Jul 05 16:16:44.743824 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:16:44.743824 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:16:44.743824 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:16:44.743824 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:16:44.743824 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:16:44.743824 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:16:44.743824 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:16:44.743824 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:16:44.743824 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:16:44.745719 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:16:44.745719 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 16:16:44.745719 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 16:16:44.745719 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 16:16:44.745719 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 16:16:44.745719 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:16:44.745719 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:16:44.745719 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:16:44.745719 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:16:44.745719 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 could not be found. Jul 05 16:16:44.745719 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:16:44.745719 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:16:44.745719 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:16:44.745719 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:16:44.745719 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:16:44.745719 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:16:44.745719 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:16:44.745719 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:16:44.745719 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 could not be found. Jul 05 16:16:44.745719 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:16:44.747358 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-ff23eb10-896f-44a6-a849-a5774069eea0 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Returning 404 to user: Instance c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:16:44.747358 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-ff23eb10-896f-44a6-a849-a5774069eea0 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66" status: 404 len: 111 microversion: 2.1 time: 0.033757 Jul 05 16:16:44.747358 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 490/929] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Jul 5 16:16:44 2022] DELETE /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 16:16:44.747358 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-5d58c24f-59a6-4b2d-a650-b611fe75f3db tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:16:44.747727 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-5d58c24f-59a6-4b2d-a650-b611fe75f3db tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:16:44.753610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5d58c24f-59a6-4b2d-a650-b611fe75f3db tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:44.754143 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5d58c24f-59a6-4b2d-a650-b611fe75f3db tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:44.754875 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5d58c24f-59a6-4b2d-a650-b611fe75f3db tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:44.755314 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5d58c24f-59a6-4b2d-a650-b611fe75f3db tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:44.768829 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-5d58c24f-59a6-4b2d-a650-b611fe75f3db tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] HTTP exception thrown: Instance c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 could not be found. Jul 05 16:16:44.770314 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-5d58c24f-59a6-4b2d-a650-b611fe75f3db tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Request method failure captured: Jul 05 16:16:44.770314 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 HTTP/1.1 Jul 05 16:16:44.770314 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:16:44.770314 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:16:44.770314 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:16:44.770314 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:16:44.770314 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:16:44.770314 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:16:44.770314 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:16:44.770314 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:16:44.770314 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIXkYoYC5OUwlwwwcN4lQebGZCDv39VJouOlBDL-ZM0IwO2NZWFjFw3CBRHJ9oZWGpw0SIJHD_3yUkxhSGoEoZ2f5SafYhKjPNSYWjCCpBNrrOpFH3EzbYoOd1JFjSWmJwf_VIM07567DnvlGW6gjYXvlrQcYGemTNCHBf3LVZpT4s Jul 05 16:16:44.770314 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:16:44.770314 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:16:44.770314 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:16:44.770314 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:16:44.770314 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:16:44.770314 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:16:44.770314 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 3ec37a457530439b8728dd2ad2b6b7bd Jul 05 16:16:44.770314 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-AttachVolumeTestJSON-187031460 Jul 05 16:16:44.770314 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:16:44.770314 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:16:44.772395 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3ec37a457530439b8728dd2ad2b6b7bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3ec37a457530439b8728dd2ad2b6b7bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3ec37a457530439b8728dd2ad2b6b7bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3ec37a457530439b8728dd2ad2b6b7bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:16:44.772395 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-AttachVolumeTestJSON-187031460 Jul 05 16:16:44.772395 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 3ec37a457530439b8728dd2ad2b6b7bd Jul 05 16:16:44.772395 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-AttachVolumeTestJSON-187031460 Jul 05 16:16:44.772395 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-AttachVolumeTestJSON-187031460-project Jul 05 16:16:44.772395 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:16:44.772395 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:16:44.772395 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: d7e2fc1ec676438392d7925b43b806f5 Jul 05 16:16:44.772395 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-AttachVolumeTestJSON-187031460-project Jul 05 16:16:44.772395 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:16:44.772395 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 could not be found. Jul 05 16:16:44.772395 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': 'c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66'} Jul 05 16:16:44.773735 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:16:44.773735 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:16:44.773735 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:16:44.773735 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:16:44.773735 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:16:44.773735 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:16:44.773735 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:16:44.773735 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:16:44.773735 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:16:44.773735 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:16:44.773735 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 could not be found. Jul 05 16:16:44.773735 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:16:44.773735 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:16:44.773735 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:16:44.773735 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:16:44.773735 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:16:44.773735 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:16:44.773735 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:16:44.773735 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:16:44.773735 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:16:44.775257 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:16:44.775257 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 16:16:44.775257 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 16:16:44.775257 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:16:44.775257 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:16:44.775257 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:16:44.775257 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:16:44.775257 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 could not be found. Jul 05 16:16:44.775257 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:16:44.775257 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:16:44.775257 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:16:44.775257 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:16:44.775257 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:16:44.775257 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:16:44.775257 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:16:44.775257 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:16:44.775257 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 could not be found. Jul 05 16:16:44.775257 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:16:44.777186 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-5d58c24f-59a6-4b2d-a650-b611fe75f3db tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Returning 404 to user: Instance c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:16:44.777186 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-5d58c24f-59a6-4b2d-a650-b611fe75f3db tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66" status: 404 len: 111 microversion: 2.1 time: 0.028799 Jul 05 16:16:44.777186 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 491/930] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:16:44 2022] GET /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 16:16:46.055594 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-8d29a849-7b30-4733-a9f0-98bc8ab91864 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:16:46.056187 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-8d29a849-7b30-4733-a9f0-98bc8ab91864 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:16:46.062639 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8d29a849-7b30-4733-a9f0-98bc8ab91864 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:46.063088 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8d29a849-7b30-4733-a9f0-98bc8ab91864 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:46.063871 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8d29a849-7b30-4733-a9f0-98bc8ab91864 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:46.064315 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8d29a849-7b30-4733-a9f0-98bc8ab91864 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:46.077603 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-8d29a849-7b30-4733-a9f0-98bc8ab91864 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] HTTP exception thrown: Instance 9b902cfe-0e0b-4ce5-b2df-67ca0464da74 could not be found. Jul 05 16:16:46.079135 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-8d29a849-7b30-4733-a9f0-98bc8ab91864 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Request method failure captured: Jul 05 16:16:46.079135 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: DELETE /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 HTTP/1.1 Jul 05 16:16:46.079135 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:16:46.079135 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:16:46.079135 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:16:46.079135 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:16:46.079135 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:16:46.079135 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:16:46.079135 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:16:46.079135 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:16:46.079135 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIXkYoYC5OUwlwwwcN4lQebGZCDv39VJouOlBDL-ZM0IwO2NZWFjFw3CBRHJ9oZWGpw0SIJHD_3yUkxhSGoEoZ2f5SafYhKjPNSYWjCCpBNrrOpFH3EzbYoOd1JFjSWmJwf_VIM07567DnvlGW6gjYXvlrQcYGemTNCHBf3LVZpT4s Jul 05 16:16:46.079135 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:16:46.079135 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:16:46.079135 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:16:46.079135 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:16:46.079135 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:16:46.079135 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:16:46.079135 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 3ec37a457530439b8728dd2ad2b6b7bd Jul 05 16:16:46.079135 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-AttachVolumeTestJSON-187031460 Jul 05 16:16:46.079135 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:16:46.079135 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:16:46.081051 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3ec37a457530439b8728dd2ad2b6b7bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3ec37a457530439b8728dd2ad2b6b7bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3ec37a457530439b8728dd2ad2b6b7bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3ec37a457530439b8728dd2ad2b6b7bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:16:46.081051 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-AttachVolumeTestJSON-187031460 Jul 05 16:16:46.081051 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 3ec37a457530439b8728dd2ad2b6b7bd Jul 05 16:16:46.081051 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-AttachVolumeTestJSON-187031460 Jul 05 16:16:46.081051 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-AttachVolumeTestJSON-187031460-project Jul 05 16:16:46.081051 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:16:46.081051 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:16:46.081051 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: d7e2fc1ec676438392d7925b43b806f5 Jul 05 16:16:46.081051 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-AttachVolumeTestJSON-187031460-project Jul 05 16:16:46.081051 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:16:46.081051 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance 9b902cfe-0e0b-4ce5-b2df-67ca0464da74 could not be found. Jul 05 16:16:46.081051 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': '9b902cfe-0e0b-4ce5-b2df-67ca0464da74'} Jul 05 16:16:46.082125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:16:46.082125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:16:46.082125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:16:46.082125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:16:46.082125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:16:46.082125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:16:46.082125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:16:46.082125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:16:46.082125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:16:46.082125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:16:46.082125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b902cfe-0e0b-4ce5-b2df-67ca0464da74 could not be found. Jul 05 16:16:46.082125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:16:46.082125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:16:46.082125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:16:46.082125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:16:46.082125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:16:46.082125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:16:46.082125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:16:46.082125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:16:46.082125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:16:46.084492 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:16:46.084492 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 16:16:46.084492 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 16:16:46.084492 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 16:16:46.084492 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 16:16:46.084492 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:16:46.084492 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:16:46.084492 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:16:46.084492 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:16:46.084492 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b902cfe-0e0b-4ce5-b2df-67ca0464da74 could not be found. Jul 05 16:16:46.084492 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:16:46.084492 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:16:46.084492 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:16:46.084492 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:16:46.084492 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:16:46.084492 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:16:46.084492 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:16:46.084492 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:16:46.084492 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b902cfe-0e0b-4ce5-b2df-67ca0464da74 could not be found. Jul 05 16:16:46.084492 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:16:46.086139 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-8d29a849-7b30-4733-a9f0-98bc8ab91864 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Returning 404 to user: Instance 9b902cfe-0e0b-4ce5-b2df-67ca0464da74 could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:16:46.086139 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-8d29a849-7b30-4733-a9f0-98bc8ab91864 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 404 len: 111 microversion: 2.1 time: 0.029436 Jul 05 16:16:46.086139 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 492/931] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Jul 5 16:16:46 2022] DELETE /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 16:16:46.089012 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-0347dfa6-ec5e-4bba-b03e-7dbf8c99d730 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:16:46.089625 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-0347dfa6-ec5e-4bba-b03e-7dbf8c99d730 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] [instance: 9b902cfe-0e0b-4ce5-b2df-67ca0464da74] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:16:46.095475 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0347dfa6-ec5e-4bba-b03e-7dbf8c99d730 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:46.095926 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0347dfa6-ec5e-4bba-b03e-7dbf8c99d730 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:46.101578 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0347dfa6-ec5e-4bba-b03e-7dbf8c99d730 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:16:46.101578 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0347dfa6-ec5e-4bba-b03e-7dbf8c99d730 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:16:46.111652 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-0347dfa6-ec5e-4bba-b03e-7dbf8c99d730 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] HTTP exception thrown: Instance 9b902cfe-0e0b-4ce5-b2df-67ca0464da74 could not be found. Jul 05 16:16:46.113249 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-0347dfa6-ec5e-4bba-b03e-7dbf8c99d730 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Request method failure captured: Jul 05 16:16:46.113249 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 HTTP/1.1 Jul 05 16:16:46.113249 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:16:46.113249 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:16:46.113249 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:16:46.113249 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:16:46.113249 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:16:46.113249 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:16:46.113249 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:16:46.113249 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:16:46.113249 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGIXkYoYC5OUwlwwwcN4lQebGZCDv39VJouOlBDL-ZM0IwO2NZWFjFw3CBRHJ9oZWGpw0SIJHD_3yUkxhSGoEoZ2f5SafYhKjPNSYWjCCpBNrrOpFH3EzbYoOd1JFjSWmJwf_VIM07567DnvlGW6gjYXvlrQcYGemTNCHBf3LVZpT4s Jul 05 16:16:46.113249 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:16:46.113249 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:16:46.113249 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:16:46.113249 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:16:46.113249 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:16:46.113249 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:16:46.113249 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 3ec37a457530439b8728dd2ad2b6b7bd Jul 05 16:16:46.113249 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-AttachVolumeTestJSON-187031460 Jul 05 16:16:46.113249 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:16:46.113249 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:16:46.114864 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3ec37a457530439b8728dd2ad2b6b7bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3ec37a457530439b8728dd2ad2b6b7bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3ec37a457530439b8728dd2ad2b6b7bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3ec37a457530439b8728dd2ad2b6b7bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:16:46.114864 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-AttachVolumeTestJSON-187031460 Jul 05 16:16:46.114864 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 3ec37a457530439b8728dd2ad2b6b7bd Jul 05 16:16:46.114864 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-AttachVolumeTestJSON-187031460 Jul 05 16:16:46.114864 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-AttachVolumeTestJSON-187031460-project Jul 05 16:16:46.114864 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:16:46.114864 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:16:46.114864 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: d7e2fc1ec676438392d7925b43b806f5 Jul 05 16:16:46.114864 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-AttachVolumeTestJSON-187031460-project Jul 05 16:16:46.114864 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:16:46.114864 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance 9b902cfe-0e0b-4ce5-b2df-67ca0464da74 could not be found. Jul 05 16:16:46.114864 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': '9b902cfe-0e0b-4ce5-b2df-67ca0464da74'} Jul 05 16:16:46.116505 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:16:46.116505 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:16:46.116505 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:16:46.116505 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:16:46.116505 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:16:46.116505 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:16:46.116505 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:16:46.116505 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:16:46.116505 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:16:46.116505 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:16:46.116505 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b902cfe-0e0b-4ce5-b2df-67ca0464da74 could not be found. Jul 05 16:16:46.116505 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:16:46.116505 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:16:46.116505 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:16:46.116505 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:16:46.116505 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:16:46.116505 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:16:46.116505 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:16:46.116505 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:16:46.116505 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:16:46.117984 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:16:46.117984 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 16:16:46.117984 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 16:16:46.117984 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:16:46.117984 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:16:46.117984 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:16:46.117984 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:16:46.117984 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b902cfe-0e0b-4ce5-b2df-67ca0464da74 could not be found. Jul 05 16:16:46.117984 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:16:46.117984 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:16:46.117984 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:16:46.117984 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:16:46.117984 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:16:46.117984 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:16:46.117984 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:16:46.117984 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:16:46.117984 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b902cfe-0e0b-4ce5-b2df-67ca0464da74 could not be found. Jul 05 16:16:46.117984 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:16:46.119391 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-0347dfa6-ec5e-4bba-b03e-7dbf8c99d730 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] Returning 404 to user: Instance 9b902cfe-0e0b-4ce5-b2df-67ca0464da74 could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:16:46.119391 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-0347dfa6-ec5e-4bba-b03e-7dbf8c99d730 tempest-AttachVolumeTestJSON-187031460 tempest-AttachVolumeTestJSON-187031460-project] 10.222.0.45 "GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74" status: 404 len: 111 microversion: 2.1 time: 0.029270 Jul 05 16:16:46.119391 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 493/932] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:16:46 2022] GET /compute/v2.1/servers/9b902cfe-0e0b-4ce5-b2df-67ca0464da74 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 16:16:54.083399 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-6b8a7dc1-79b5-4371-b90f-b8a3fcdcd387 tempest-VolumesTestJSON-456237091 tempest-VolumesTestJSON-456237091-project] Calling method '.version_select at 0x7f3087deeee0>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:16:54.130665 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-6b8a7dc1-79b5-4371-b90f-b8a3fcdcd387 tempest-VolumesTestJSON-456237091 tempest-VolumesTestJSON-456237091-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/ac6b2bea-ff85-43b7-a014-f6f760a7b57d" status: 200 len: 351 microversion: 2.1 time: 0.051157 Jul 05 16:16:54.131236 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 494/933] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Jul 5 16:16:54 2022] GET /compute/v2.1/os-volumes/ac6b2bea-ff85-43b7-a014-f6f760a7b57d => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:16:55.725467 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-39db6cf0-c19b-485f-9be5-e3a8745da3f3 tempest-VolumesTestJSON-456237091 tempest-VolumesTestJSON-456237091-project] Calling method '.version_select at 0x7f3087f544c0>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:16:55.770823 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-39db6cf0-c19b-485f-9be5-e3a8745da3f3 tempest-VolumesTestJSON-456237091 tempest-VolumesTestJSON-456237091-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/eb6c5730-e0da-4937-950c-edec7784119e" status: 200 len: 351 microversion: 2.1 time: 0.049590 Jul 05 16:16:55.771394 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 495/934] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Jul 5 16:16:55 2022] GET /compute/v2.1/os-volumes/eb6c5730-e0da-4937-950c-edec7784119e => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:16:57.412367 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:16:57.413351 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=8 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:16:57.417718 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-59916463-7ef8-4e71-ab97-5270acb46be3 tempest-VolumesTestJSON-456237091 tempest-VolumesTestJSON-456237091-project] Calling method '.version_select at 0x7f3087f45670>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:16:57.466884 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-59916463-7ef8-4e71-ab97-5270acb46be3 tempest-VolumesTestJSON-456237091 tempest-VolumesTestJSON-456237091-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/7e3f24f7-a228-456b-94c6-1ea246640d8c" status: 200 len: 351 microversion: 2.1 time: 0.055585 Jul 05 16:16:57.467454 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 496/935] 10.222.0.45 () {58 vars in 1244 bytes} [Tue Jul 5 16:16:57 2022] GET /compute/v2.1/os-volumes/7e3f24f7-a228-456b-94c6-1ea246640d8c => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:16:57.478454 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-6c40ecaf-b864-4b53-ba98-af2b149957ff tempest-VolumesTestJSON-456237091 tempest-VolumesTestJSON-456237091-project] Calling method '.version_select at 0x7f3087c8ddc0>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:16:57.561369 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-6c40ecaf-b864-4b53-ba98-af2b149957ff tempest-VolumesTestJSON-456237091 tempest-VolumesTestJSON-456237091-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.086726 Jul 05 16:16:57.561948 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 497/936] 10.222.0.45 () {58 vars in 1133 bytes} [Tue Jul 5 16:16:57 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:16:57.574147 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-332943c9-fd52-4df9-b270-952e84c4f136 tempest-VolumesTestJSON-456237091 tempest-VolumesTestJSON-456237091-project] Calling method '.version_select at 0x7f3087c08280>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:16:57.655555 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-332943c9-fd52-4df9-b270-952e84c4f136 tempest-VolumesTestJSON-456237091 tempest-VolumesTestJSON-456237091-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085570 Jul 05 16:16:57.656126 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 498/937] 10.222.0.45 () {58 vars in 1148 bytes} [Tue Jul 5 16:16:57 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:16:57.668293 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-a30a1736-c64a-4826-8aa5-3426a87bcd23 tempest-VolumesTestJSON-456237091 tempest-VolumesTestJSON-456237091-project] Calling method '.version_select at 0x7f3087f65d30>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:16:57.748188 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-a30a1736-c64a-4826-8aa5-3426a87bcd23 tempest-VolumesTestJSON-456237091 tempest-VolumesTestJSON-456237091-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.084208 Jul 05 16:16:57.748784 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 499/938] 10.222.0.45 () {58 vars in 1133 bytes} [Tue Jul 5 16:16:57 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:16:57.759368 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-64c82ac2-9225-4219-a278-6038c02ee5e4 tempest-VolumesTestJSON-456237091 tempest-VolumesTestJSON-456237091-project] Calling method '.version_select at 0x7f3087f01ca0>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:16:57.847524 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-64c82ac2-9225-4219-a278-6038c02ee5e4 tempest-VolumesTestJSON-456237091 tempest-VolumesTestJSON-456237091-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091592 Jul 05 16:16:57.848098 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 500/939] 10.222.0.45 () {58 vars in 1166 bytes} [Tue Jul 5 16:16:57 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:16:57.859550 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-f237195e-d565-4255-a9b8-ed0a96c92eb2 tempest-VolumesTestJSON-456237091 tempest-VolumesTestJSON-456237091-project] Calling method '.version_select at 0x7f3087dee700>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:16:57.939348 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-f237195e-d565-4255-a9b8-ed0a96c92eb2 tempest-VolumesTestJSON-456237091 tempest-VolumesTestJSON-456237091-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.083210 Jul 05 16:16:57.939996 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 501/940] 10.222.0.45 () {58 vars in 1169 bytes} [Tue Jul 5 16:16:57 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:16:57.952586 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-48c1b929-e117-4151-94b6-51d6124602a8 tempest-VolumesTestJSON-456237091 tempest-VolumesTestJSON-456237091-project] Calling method '.version_select at 0x7f3087f29a60>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:16:58.033766 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-48c1b929-e117-4151-94b6-51d6124602a8 tempest-VolumesTestJSON-456237091 tempest-VolumesTestJSON-456237091-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.084794 Jul 05 16:16:58.034336 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 502/941] 10.222.0.45 () {58 vars in 1154 bytes} [Tue Jul 5 16:16:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:16:58.045198 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-0d15e33c-cdfd-4bc5-b592-2051cf1c560f tempest-VolumesTestJSON-456237091 tempest-VolumesTestJSON-456237091-project] Calling method '.version_select at 0x7f3087f54550>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:16:58.132827 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-0d15e33c-cdfd-4bc5-b592-2051cf1c560f tempest-VolumesTestJSON-456237091 tempest-VolumesTestJSON-456237091-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091148 Jul 05 16:16:58.134114 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 503/942] 10.222.0.45 () {58 vars in 1187 bytes} [Tue Jul 5 16:16:58 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:16:58.145379 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-e0fdb558-385e-4194-83b8-f9bab1d5baa9 tempest-VolumesTestJSON-456237091 tempest-VolumesTestJSON-456237091-project] Calling method '.version_select at 0x7f309413d430>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:16:58.229548 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-e0fdb558-385e-4194-83b8-f9bab1d5baa9 tempest-VolumesTestJSON-456237091 tempest-VolumesTestJSON-456237091-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.087738 Jul 05 16:16:58.230142 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 504/943] 10.222.0.45 () {58 vars in 1154 bytes} [Tue Jul 5 16:16:58 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:17:21.986098 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 16:17:21.986543 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Tue Jul 5 16:17:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 (ip 10.222.0.45) !!! Jul 05 16:17:22.271216 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-84c50a30-3c0d-4677-bdc9-8f99f43b640b tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-719897655", "imageRef": "c5805086-2ebd-4742-8185-f79894fef91e", "flavorRef": "452"}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:17:22.322110 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.network.neutron [None req-84c50a30-3c0d-4677-bdc9-8f99f43b640b tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] validate_networks() for None {{(pid=118320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 16:17:22.823077 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-84c50a30-3c0d-4677-bdc9-8f99f43b640b tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Flavor limits 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 16:17:22.823506 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-84c50a30-3c0d-4677-bdc9-8f99f43b640b tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Image limits 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 16:17:22.824574 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-84c50a30-3c0d-4677-bdc9-8f99f43b640b tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Flavor pref 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 16:17:22.825011 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-84c50a30-3c0d-4677-bdc9-8f99f43b640b tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Image pref 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 16:17:22.825426 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-84c50a30-3c0d-4677-bdc9-8f99f43b640b tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 16:17:22.835291 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-84c50a30-3c0d-4677-bdc9-8f99f43b640b tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:22.835737 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-84c50a30-3c0d-4677-bdc9-8f99f43b640b tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:22.836538 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-84c50a30-3c0d-4677-bdc9-8f99f43b640b tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:22.837011 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-84c50a30-3c0d-4677-bdc9-8f99f43b640b tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:22.853765 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-84c50a30-3c0d-4677-bdc9-8f99f43b640b tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Getting quotas for project 74d513d7cde3430f880b5dd5641d5356. Resources: {'ram', 'instances', 'cores'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:17:22.857705 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-84c50a30-3c0d-4677-bdc9-8f99f43b640b tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Getting quotas for user 0bb4d27ce2104d1086ef35180812b09e and project 74d513d7cde3430f880b5dd5641d5356. Resources: {'ram', 'instances', 'cores'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:17:22.868826 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-84c50a30-3c0d-4677-bdc9-8f99f43b640b tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Going to run 1 instances... {{(pid=118320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 16:17:22.871584 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-84c50a30-3c0d-4677-bdc9-8f99f43b640b tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] [instance: a957f720-7f55-47ad-9d0e-8ab460980ba1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5805086-2ebd-4742-8185-f79894fef91e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 16:17:22.992878 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-84c50a30-3c0d-4677-bdc9-8f99f43b640b tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.726103 Jul 05 16:17:22.993810 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 505/944] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Jul 5 16:17:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 05 16:17:23.003852 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-2ea586c8-07e9-474e-be46-f3e30e1c5112 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:17:23.004473 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-2ea586c8-07e9-474e-be46-f3e30e1c5112 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] [instance: a957f720-7f55-47ad-9d0e-8ab460980ba1] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:17:23.062611 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-2ea586c8-07e9-474e-be46-f3e30e1c5112 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb4d27ce2104d1086ef35180812b09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d513d7cde3430f880b5dd5641d5356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:17:23.069727 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-2ea586c8-07e9-474e-be46-f3e30e1c5112 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] 10.222.0.45 "GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1" status: 200 len: 1214 microversion: 2.1 time: 0.069659 Jul 05 16:17:23.070285 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 506/945] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:17:22 2022] GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:17:24.086726 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-d42e85cd-14f8-4486-822a-9ea55de2a7c9 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:17:24.087350 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-d42e85cd-14f8-4486-822a-9ea55de2a7c9 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] [instance: a957f720-7f55-47ad-9d0e-8ab460980ba1] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:17:24.141063 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-d42e85cd-14f8-4486-822a-9ea55de2a7c9 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb4d27ce2104d1086ef35180812b09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d513d7cde3430f880b5dd5641d5356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:17:24.147855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-d42e85cd-14f8-4486-822a-9ea55de2a7c9 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] 10.222.0.45 "GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1" status: 200 len: 1214 microversion: 2.1 time: 0.065132 Jul 05 16:17:24.148413 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 507/946] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:17:24 2022] GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:17:25.165643 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-dd37e74c-0504-4ce7-85fe-80d4096c2ebb tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:17:25.166353 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-dd37e74c-0504-4ce7-85fe-80d4096c2ebb tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] [instance: a957f720-7f55-47ad-9d0e-8ab460980ba1] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:17:25.173329 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dd37e74c-0504-4ce7-85fe-80d4096c2ebb tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:25.173776 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dd37e74c-0504-4ce7-85fe-80d4096c2ebb tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:25.174538 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dd37e74c-0504-4ce7-85fe-80d4096c2ebb tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:25.174977 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dd37e74c-0504-4ce7-85fe-80d4096c2ebb tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:25.235800 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-dd37e74c-0504-4ce7-85fe-80d4096c2ebb tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb4d27ce2104d1086ef35180812b09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d513d7cde3430f880b5dd5641d5356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:17:25.243162 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-dd37e74c-0504-4ce7-85fe-80d4096c2ebb tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] 10.222.0.45 "GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1" status: 200 len: 1218 microversion: 2.1 time: 0.081414 Jul 05 16:17:25.243735 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 508/947] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:17:25 2022] GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:17:26.259435 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-da1e62cd-88ce-425a-9465-afb6b56d7f81 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:17:26.260060 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-da1e62cd-88ce-425a-9465-afb6b56d7f81 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] [instance: a957f720-7f55-47ad-9d0e-8ab460980ba1] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:17:26.267265 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-da1e62cd-88ce-425a-9465-afb6b56d7f81 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:26.267721 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-da1e62cd-88ce-425a-9465-afb6b56d7f81 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:26.268510 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-da1e62cd-88ce-425a-9465-afb6b56d7f81 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:26.268972 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-da1e62cd-88ce-425a-9465-afb6b56d7f81 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:26.330114 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-da1e62cd-88ce-425a-9465-afb6b56d7f81 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb4d27ce2104d1086ef35180812b09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d513d7cde3430f880b5dd5641d5356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:17:26.337476 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-da1e62cd-88ce-425a-9465-afb6b56d7f81 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] 10.222.0.45 "GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1" status: 200 len: 1218 microversion: 2.1 time: 0.081957 Jul 05 16:17:26.338041 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 509/948] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:17:26 2022] GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:17:27.354577 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-fca04d20-4221-4960-95a8-324afe80dc64 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:17:27.355892 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-fca04d20-4221-4960-95a8-324afe80dc64 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] [instance: a957f720-7f55-47ad-9d0e-8ab460980ba1] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:17:27.362770 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fca04d20-4221-4960-95a8-324afe80dc64 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:27.363224 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fca04d20-4221-4960-95a8-324afe80dc64 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:27.363990 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fca04d20-4221-4960-95a8-324afe80dc64 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:27.364425 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fca04d20-4221-4960-95a8-324afe80dc64 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:27.428168 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-fca04d20-4221-4960-95a8-324afe80dc64 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb4d27ce2104d1086ef35180812b09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d513d7cde3430f880b5dd5641d5356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:17:27.435585 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-fca04d20-4221-4960-95a8-324afe80dc64 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] 10.222.0.45 "GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1" status: 200 len: 1266 microversion: 2.1 time: 0.084835 Jul 05 16:17:27.439151 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 510/949] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:17:27 2022] GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:17:28.452003 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-f1c56cbd-6566-4b9e-a058-d92192dc08a5 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:17:28.452682 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-f1c56cbd-6566-4b9e-a058-d92192dc08a5 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] [instance: a957f720-7f55-47ad-9d0e-8ab460980ba1] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:17:28.458973 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f1c56cbd-6566-4b9e-a058-d92192dc08a5 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:28.459422 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f1c56cbd-6566-4b9e-a058-d92192dc08a5 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:28.460177 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f1c56cbd-6566-4b9e-a058-d92192dc08a5 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:28.460616 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f1c56cbd-6566-4b9e-a058-d92192dc08a5 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:28.533802 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-f1c56cbd-6566-4b9e-a058-d92192dc08a5 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb4d27ce2104d1086ef35180812b09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d513d7cde3430f880b5dd5641d5356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:17:28.541054 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-f1c56cbd-6566-4b9e-a058-d92192dc08a5 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] 10.222.0.45 "GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1" status: 200 len: 1272 microversion: 2.1 time: 0.092906 Jul 05 16:17:28.541616 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 511/950] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:17:28 2022] GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1 => generated 1272 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:17:29.559119 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-5f983b21-298e-4b70-a78a-9e15b9fc75ae tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:17:29.559753 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-5f983b21-298e-4b70-a78a-9e15b9fc75ae tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] [instance: a957f720-7f55-47ad-9d0e-8ab460980ba1] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:17:29.565901 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5f983b21-298e-4b70-a78a-9e15b9fc75ae tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:29.566355 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5f983b21-298e-4b70-a78a-9e15b9fc75ae tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:29.567119 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5f983b21-298e-4b70-a78a-9e15b9fc75ae tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:29.567560 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5f983b21-298e-4b70-a78a-9e15b9fc75ae tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:29.739484 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-5f983b21-298e-4b70-a78a-9e15b9fc75ae tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb4d27ce2104d1086ef35180812b09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d513d7cde3430f880b5dd5641d5356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:17:29.752697 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-5f983b21-298e-4b70-a78a-9e15b9fc75ae tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] 10.222.0.45 "GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1" status: 200 len: 1314 microversion: 2.1 time: 0.197679 Jul 05 16:17:29.753143 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 512/951] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:17:29 2022] GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:17:29.758166 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-f7434acd-d950-45c9-acdd-1eef4d627f22 req-afb9a70d-a0d3-4c5a-b413-7ddaf19e4d14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a957f720-7f55-47ad-9d0e-8ab460980ba1", "tag": "6bad20a7-7c58-487a-9529-a6b88c4f83c5"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:17:29.770247 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-f7434acd-d950-45c9-acdd-1eef4d627f22 req-afb9a70d-a0d3-4c5a-b413-7ddaf19e4d14 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:29.770943 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-f7434acd-d950-45c9-acdd-1eef4d627f22 req-afb9a70d-a0d3-4c5a-b413-7ddaf19e4d14 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:29.782570 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-f7434acd-d950-45c9-acdd-1eef4d627f22 req-afb9a70d-a0d3-4c5a-b413-7ddaf19e4d14 service nova] Creating event network-changed:6bad20a7-7c58-487a-9529-a6b88c4f83c5 for instance a957f720-7f55-47ad-9d0e-8ab460980ba1 on hv-cinder-84875 Jul 05 16:17:29.788137 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-f7434acd-d950-45c9-acdd-1eef4d627f22 req-afb9a70d-a0d3-4c5a-b413-7ddaf19e4d14 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033329 Jul 05 16:17:29.788774 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 513/952] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:17:30.770758 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-3367bd2c-13f1-4bd4-9ed2-be03c3541557 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:17:30.771689 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-3367bd2c-13f1-4bd4-9ed2-be03c3541557 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] [instance: a957f720-7f55-47ad-9d0e-8ab460980ba1] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:17:30.778976 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3367bd2c-13f1-4bd4-9ed2-be03c3541557 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:30.779424 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3367bd2c-13f1-4bd4-9ed2-be03c3541557 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:30.780180 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3367bd2c-13f1-4bd4-9ed2-be03c3541557 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:30.780616 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3367bd2c-13f1-4bd4-9ed2-be03c3541557 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:30.936751 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-3367bd2c-13f1-4bd4-9ed2-be03c3541557 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb4d27ce2104d1086ef35180812b09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d513d7cde3430f880b5dd5641d5356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:17:30.944420 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-3367bd2c-13f1-4bd4-9ed2-be03c3541557 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] 10.222.0.45 "GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1" status: 200 len: 1314 microversion: 2.1 time: 0.178006 Jul 05 16:17:30.945045 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 514/953] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:17:30 2022] GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:17:31.962073 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-9c9b3aad-2b4f-4029-8fae-e7f8006f1983 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:17:31.962726 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-9c9b3aad-2b4f-4029-8fae-e7f8006f1983 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] [instance: a957f720-7f55-47ad-9d0e-8ab460980ba1] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:17:31.969540 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9c9b3aad-2b4f-4029-8fae-e7f8006f1983 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:31.969985 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9c9b3aad-2b4f-4029-8fae-e7f8006f1983 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:31.970739 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9c9b3aad-2b4f-4029-8fae-e7f8006f1983 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:31.971172 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9c9b3aad-2b4f-4029-8fae-e7f8006f1983 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:32.096028 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-9c9b3aad-2b4f-4029-8fae-e7f8006f1983 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb4d27ce2104d1086ef35180812b09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d513d7cde3430f880b5dd5641d5356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:17:32.103359 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-9c9b3aad-2b4f-4029-8fae-e7f8006f1983 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] 10.222.0.45 "GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1" status: 200 len: 1314 microversion: 2.1 time: 0.145272 Jul 05 16:17:32.103919 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 515/954] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:17:31 2022] GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:17:33.121289 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-71d14e29-47ec-45f9-93a0-2b9953003db1 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:17:33.121937 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-71d14e29-47ec-45f9-93a0-2b9953003db1 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] [instance: a957f720-7f55-47ad-9d0e-8ab460980ba1] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:17:33.123982 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell0:SELECT=2 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:17:33.129355 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-71d14e29-47ec-45f9-93a0-2b9953003db1 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:33.129810 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-71d14e29-47ec-45f9-93a0-2b9953003db1 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:33.130579 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-71d14e29-47ec-45f9-93a0-2b9953003db1 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:33.131014 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-71d14e29-47ec-45f9-93a0-2b9953003db1 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:33.323869 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-71d14e29-47ec-45f9-93a0-2b9953003db1 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb4d27ce2104d1086ef35180812b09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d513d7cde3430f880b5dd5641d5356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:17:33.331336 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-71d14e29-47ec-45f9-93a0-2b9953003db1 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] 10.222.0.45 "GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1" status: 200 len: 1314 microversion: 2.1 time: 0.214683 Jul 05 16:17:33.331905 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 516/955] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:17:33 2022] GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:17:34.348821 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-a4822868-e492-4b14-ae22-574c3c808dc9 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:17:34.349447 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-a4822868-e492-4b14-ae22-574c3c808dc9 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] [instance: a957f720-7f55-47ad-9d0e-8ab460980ba1] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:17:34.351709 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell0:SELECT=10 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:17:34.357071 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a4822868-e492-4b14-ae22-574c3c808dc9 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:34.357527 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a4822868-e492-4b14-ae22-574c3c808dc9 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:34.358288 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a4822868-e492-4b14-ae22-574c3c808dc9 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:34.358729 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a4822868-e492-4b14-ae22-574c3c808dc9 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:34.488280 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-a4822868-e492-4b14-ae22-574c3c808dc9 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb4d27ce2104d1086ef35180812b09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d513d7cde3430f880b5dd5641d5356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:17:34.497380 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-a4822868-e492-4b14-ae22-574c3c808dc9 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] 10.222.0.45 "GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1" status: 200 len: 1314 microversion: 2.1 time: 0.152442 Jul 05 16:17:34.497951 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 517/956] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:17:34 2022] GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:17:35.112131 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-ab506112-d39f-4b15-b244-39260e3f127b req-d36af333-02bd-4fc4-8578-ccae65c6e71f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a957f720-7f55-47ad-9d0e-8ab460980ba1", "name": "network-vif-plugged", "status": "completed", "tag": "6bad20a7-7c58-487a-9529-a6b88c4f83c5"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:17:35.120345 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-ab506112-d39f-4b15-b244-39260e3f127b req-d36af333-02bd-4fc4-8578-ccae65c6e71f service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:35.121115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-ab506112-d39f-4b15-b244-39260e3f127b req-d36af333-02bd-4fc4-8578-ccae65c6e71f service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:35.132188 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-ab506112-d39f-4b15-b244-39260e3f127b req-d36af333-02bd-4fc4-8578-ccae65c6e71f service nova] Creating event network-vif-plugged:6bad20a7-7c58-487a-9529-a6b88c4f83c5 for instance a957f720-7f55-47ad-9d0e-8ab460980ba1 on hv-cinder-84875 Jul 05 16:17:35.139542 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-ab506112-d39f-4b15-b244-39260e3f127b req-d36af333-02bd-4fc4-8578-ccae65c6e71f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031595 Jul 05 16:17:35.140845 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 518/957] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:17:35.515547 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-1df6641f-427b-4168-8001-895ce6426ea9 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:17:35.516259 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-1df6641f-427b-4168-8001-895ce6426ea9 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] [instance: a957f720-7f55-47ad-9d0e-8ab460980ba1] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:17:35.522440 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1df6641f-427b-4168-8001-895ce6426ea9 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:35.522893 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1df6641f-427b-4168-8001-895ce6426ea9 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:35.523654 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1df6641f-427b-4168-8001-895ce6426ea9 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:35.524095 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1df6641f-427b-4168-8001-895ce6426ea9 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:35.651937 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-1df6641f-427b-4168-8001-895ce6426ea9 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb4d27ce2104d1086ef35180812b09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d513d7cde3430f880b5dd5641d5356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:17:35.659460 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-1df6641f-427b-4168-8001-895ce6426ea9 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] 10.222.0.45 "GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1" status: 200 len: 1314 microversion: 2.1 time: 0.149153 Jul 05 16:17:35.660025 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 519/958] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:17:35 2022] GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:17:36.675280 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-7335bcd7-db67-4194-8b99-ae357e8ecc28 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:17:36.675955 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-7335bcd7-db67-4194-8b99-ae357e8ecc28 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] [instance: a957f720-7f55-47ad-9d0e-8ab460980ba1] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:17:36.682409 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7335bcd7-db67-4194-8b99-ae357e8ecc28 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:36.682853 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7335bcd7-db67-4194-8b99-ae357e8ecc28 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:36.683608 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7335bcd7-db67-4194-8b99-ae357e8ecc28 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:36.684040 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-7335bcd7-db67-4194-8b99-ae357e8ecc28 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:36.811260 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-7335bcd7-db67-4194-8b99-ae357e8ecc28 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb4d27ce2104d1086ef35180812b09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d513d7cde3430f880b5dd5641d5356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:17:36.818812 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-7335bcd7-db67-4194-8b99-ae357e8ecc28 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] 10.222.0.45 "GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1" status: 200 len: 1463 microversion: 2.1 time: 0.147359 Jul 05 16:17:36.819382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 520/959] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:17:36 2022] GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1 => generated 1463 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:17:36.858423 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-c00804f7-85d7-414e-b4b6-866005279a27 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:17:36.858921 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-c00804f7-85d7-414e-b4b6-866005279a27 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] [instance: a957f720-7f55-47ad-9d0e-8ab460980ba1] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:17:36.865291 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c00804f7-85d7-414e-b4b6-866005279a27 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:36.865738 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c00804f7-85d7-414e-b4b6-866005279a27 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:36.866496 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c00804f7-85d7-414e-b4b6-866005279a27 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:36.866960 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c00804f7-85d7-414e-b4b6-866005279a27 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:36.892046 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-c00804f7-85d7-414e-b4b6-866005279a27 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] [instance: a957f720-7f55-47ad-9d0e-8ab460980ba1] Going to try to terminate instance {{(pid=118320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 16:17:37.208235 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-c00804f7-85d7-414e-b4b6-866005279a27 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1" status: 204 len: 0 microversion: 2.1 time: 0.353574 Jul 05 16:17:37.208884 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 521/960] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Jul 5 16:17:36 2022] DELETE /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 05 16:17:37.216980 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-25f2c29f-bea4-4f38-836c-149363b4b7d9 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:17:37.219403 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-25f2c29f-bea4-4f38-836c-149363b4b7d9 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] [instance: a957f720-7f55-47ad-9d0e-8ab460980ba1] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:17:37.223431 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-25f2c29f-bea4-4f38-836c-149363b4b7d9 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:37.223882 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-25f2c29f-bea4-4f38-836c-149363b4b7d9 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:37.224645 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-25f2c29f-bea4-4f38-836c-149363b4b7d9 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:37.225123 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-25f2c29f-bea4-4f38-836c-149363b4b7d9 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:37.357105 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-25f2c29f-bea4-4f38-836c-149363b4b7d9 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb4d27ce2104d1086ef35180812b09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d513d7cde3430f880b5dd5641d5356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:17:37.364758 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-25f2c29f-bea4-4f38-836c-149363b4b7d9 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] 10.222.0.45 "GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1" status: 200 len: 1469 microversion: 2.1 time: 0.151711 Jul 05 16:17:37.365344 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 522/961] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:17:37 2022] GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1 => generated 1469 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:17:38.382433 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-42f879bc-9b5c-4839-abda-16c41f9809af tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:17:38.383059 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-42f879bc-9b5c-4839-abda-16c41f9809af tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] [instance: a957f720-7f55-47ad-9d0e-8ab460980ba1] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:17:38.390031 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-42f879bc-9b5c-4839-abda-16c41f9809af tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:38.390477 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-42f879bc-9b5c-4839-abda-16c41f9809af tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:38.391237 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-42f879bc-9b5c-4839-abda-16c41f9809af tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:38.391672 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-42f879bc-9b5c-4839-abda-16c41f9809af tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:38.543614 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-42f879bc-9b5c-4839-abda-16c41f9809af tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb4d27ce2104d1086ef35180812b09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d513d7cde3430f880b5dd5641d5356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:17:38.547092 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:17:38.552107 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-42f879bc-9b5c-4839-abda-16c41f9809af tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] 10.222.0.45 "GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1" status: 200 len: 1469 microversion: 2.1 time: 0.173524 Jul 05 16:17:38.553018 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 523/962] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:17:38 2022] GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1 => generated 1469 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:17:39.051748 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-38a12f72-7f43-41ca-94bf-e0ff08873b1e req-64c0d526-bc96-4761-8548-f98d2eca3590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a957f720-7f55-47ad-9d0e-8ab460980ba1", "name": "network-vif-deleted", "tag": "6bad20a7-7c58-487a-9529-a6b88c4f83c5"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:17:39.061349 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-38a12f72-7f43-41ca-94bf-e0ff08873b1e req-64c0d526-bc96-4761-8548-f98d2eca3590 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:39.063060 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-38a12f72-7f43-41ca-94bf-e0ff08873b1e req-64c0d526-bc96-4761-8548-f98d2eca3590 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:39.073532 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-38a12f72-7f43-41ca-94bf-e0ff08873b1e req-64c0d526-bc96-4761-8548-f98d2eca3590 service nova] Creating event network-vif-deleted:6bad20a7-7c58-487a-9529-a6b88c4f83c5 for instance a957f720-7f55-47ad-9d0e-8ab460980ba1 on hv-cinder-84875 Jul 05 16:17:39.078486 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-38a12f72-7f43-41ca-94bf-e0ff08873b1e req-64c0d526-bc96-4761-8548-f98d2eca3590 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030603 Jul 05 16:17:39.079106 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 524/963] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:17:39.571019 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-86851c37-9a26-4263-bb1d-c23c0e6d9145 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:17:39.571719 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-86851c37-9a26-4263-bb1d-c23c0e6d9145 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] [instance: a957f720-7f55-47ad-9d0e-8ab460980ba1] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:17:39.578723 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-86851c37-9a26-4263-bb1d-c23c0e6d9145 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:39.579172 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-86851c37-9a26-4263-bb1d-c23c0e6d9145 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:39.579991 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-86851c37-9a26-4263-bb1d-c23c0e6d9145 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:39.580403 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-86851c37-9a26-4263-bb1d-c23c0e6d9145 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:39.612269 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-86851c37-9a26-4263-bb1d-c23c0e6d9145 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:39.612726 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-86851c37-9a26-4263-bb1d-c23c0e6d9145 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:39.613203 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.objects.instance [None req-86851c37-9a26-4263-bb1d-c23c0e6d9145 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lazy-loading 'fault' on Instance uuid a957f720-7f55-47ad-9d0e-8ab460980ba1 {{(pid=118320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 16:17:39.654912 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-86851c37-9a26-4263-bb1d-c23c0e6d9145 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb4d27ce2104d1086ef35180812b09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d513d7cde3430f880b5dd5641d5356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:17:39.662280 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-86851c37-9a26-4263-bb1d-c23c0e6d9145 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] 10.222.0.45 "GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1" status: 200 len: 1304 microversion: 2.1 time: 0.096276 Jul 05 16:17:39.662843 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 525/964] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:17:39 2022] GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:17:40.682412 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-ca6c6a3a-f972-41ce-bec3-faa58dace672 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:17:40.683036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-ca6c6a3a-f972-41ce-bec3-faa58dace672 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] [instance: a957f720-7f55-47ad-9d0e-8ab460980ba1] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:17:40.689473 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ca6c6a3a-f972-41ce-bec3-faa58dace672 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:40.689916 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ca6c6a3a-f972-41ce-bec3-faa58dace672 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:40.690670 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ca6c6a3a-f972-41ce-bec3-faa58dace672 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:40.691106 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ca6c6a3a-f972-41ce-bec3-faa58dace672 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:40.706006 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-ca6c6a3a-f972-41ce-bec3-faa58dace672 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] HTTP exception thrown: Instance a957f720-7f55-47ad-9d0e-8ab460980ba1 could not be found. Jul 05 16:17:40.707595 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-ca6c6a3a-f972-41ce-bec3-faa58dace672 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Request method failure captured: Jul 05 16:17:40.707595 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1 HTTP/1.1 Jul 05 16:17:40.707595 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:17:40.707595 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:17:40.707595 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:17:40.707595 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:17:40.707595 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:17:40.707595 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:17:40.707595 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:17:40.707595 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:17:40.707595 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGQQ431RrxktU8tzNXtQNEA_45SzaJXaZi0DIRCL2C8lsoJ2__Ovvu9Q3lwrLBtq8uEX4pfZi42jPUtBPFddQ3n9Q761mwxhjbwF6ld-1_Dat481qRbfjSfxlhuTnunrZMbAkAXPrFyYVruFR_-H2nrg1KKO0QJQrJ-VkIG3y9LAwCA Jul 05 16:17:40.707595 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:17:40.707595 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:17:40.707595 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:17:40.707595 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:17:40.707595 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:17:40.707595 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:17:40.707595 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 74d513d7cde3430f880b5dd5641d5356 Jul 05 16:17:40.707595 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-VolumesNegativeTest-1498743926 Jul 05 16:17:40.707595 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:17:40.707595 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:17:40.709236 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_74d513d7cde3430f880b5dd5641d5356"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/74d513d7cde3430f880b5dd5641d5356"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74d513d7cde3430f880b5dd5641d5356"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/74d513d7cde3430f880b5dd5641d5356"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:17:40.709236 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-VolumesNegativeTest-1498743926 Jul 05 16:17:40.709236 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 74d513d7cde3430f880b5dd5641d5356 Jul 05 16:17:40.709236 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-VolumesNegativeTest-1498743926 Jul 05 16:17:40.709236 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-VolumesNegativeTest-1498743926-project Jul 05 16:17:40.709236 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:17:40.709236 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:17:40.709236 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: 0bb4d27ce2104d1086ef35180812b09e Jul 05 16:17:40.709236 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-VolumesNegativeTest-1498743926-project Jul 05 16:17:40.709236 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:17:40.709236 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance a957f720-7f55-47ad-9d0e-8ab460980ba1 could not be found. Jul 05 16:17:40.709236 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': 'a957f720-7f55-47ad-9d0e-8ab460980ba1'} Jul 05 16:17:40.710036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:17:40.710036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:17:40.710036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:17:40.710036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:17:40.710036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:17:40.710036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:17:40.710036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:17:40.710036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:17:40.710036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:17:40.710036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:17:40.710036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a957f720-7f55-47ad-9d0e-8ab460980ba1 could not be found. Jul 05 16:17:40.710036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:17:40.710036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:17:40.710036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:17:40.710036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:17:40.710036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:17:40.710036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:17:40.710036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:17:40.710036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:17:40.710036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:17:40.711610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:17:40.711610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 16:17:40.711610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 16:17:40.711610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:17:40.711610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:17:40.711610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:17:40.711610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:17:40.711610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a957f720-7f55-47ad-9d0e-8ab460980ba1 could not be found. Jul 05 16:17:40.711610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:17:40.711610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:17:40.711610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:17:40.711610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:17:40.711610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:17:40.711610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:17:40.711610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:17:40.711610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:17:40.711610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a957f720-7f55-47ad-9d0e-8ab460980ba1 could not be found. Jul 05 16:17:40.711610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:17:40.713632 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-ca6c6a3a-f972-41ce-bec3-faa58dace672 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] Returning 404 to user: Instance a957f720-7f55-47ad-9d0e-8ab460980ba1 could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:17:40.713632 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-ca6c6a3a-f972-41ce-bec3-faa58dace672 tempest-VolumesNegativeTest-1498743926 tempest-VolumesNegativeTest-1498743926-project] 10.222.0.45 "GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1" status: 404 len: 111 microversion: 2.1 time: 0.030421 Jul 05 16:17:40.713632 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 526/965] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:17:40 2022] GET /compute/v2.1/servers/a957f720-7f55-47ad-9d0e-8ab460980ba1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 16:17:51.398225 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-29759f62-bd8c-496b-9787-32bc0a500098 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1911106694", "imageRef": "c5805086-2ebd-4742-8185-f79894fef91e", "flavorRef": "452", "networks": [{"uuid": "9842c0a5-0f39-435c-a75f-f8cd01594524"}]}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:17:51.405859 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:17:51.406504 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=12 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:17:51.450718 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.network.neutron [None req-29759f62-bd8c-496b-9787-32bc0a500098 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] validate_networks() for [('9842c0a5-0f39-435c-a75f-f8cd01594524', None, None, None, None, None)] {{(pid=118320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 16:17:51.787140 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-29759f62-bd8c-496b-9787-32bc0a500098 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Flavor limits 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 16:17:51.787566 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-29759f62-bd8c-496b-9787-32bc0a500098 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Image limits 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 16:17:51.788039 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-29759f62-bd8c-496b-9787-32bc0a500098 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Flavor pref 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 16:17:51.788446 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-29759f62-bd8c-496b-9787-32bc0a500098 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Image pref 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 16:17:51.788883 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-29759f62-bd8c-496b-9787-32bc0a500098 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 16:17:51.797752 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-29759f62-bd8c-496b-9787-32bc0a500098 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:51.798203 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-29759f62-bd8c-496b-9787-32bc0a500098 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:51.799028 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-29759f62-bd8c-496b-9787-32bc0a500098 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:51.799469 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-29759f62-bd8c-496b-9787-32bc0a500098 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:51.816966 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-29759f62-bd8c-496b-9787-32bc0a500098 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Getting quotas for project 247d4348634044b9840ae86b7022d72c. Resources: {'ram', 'instances', 'cores'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:17:51.820810 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-29759f62-bd8c-496b-9787-32bc0a500098 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Getting quotas for user e41741d00cf04063a21d163842ed5abe and project 247d4348634044b9840ae86b7022d72c. Resources: {'ram', 'instances', 'cores'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:17:51.832091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-29759f62-bd8c-496b-9787-32bc0a500098 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Going to run 1 instances... {{(pid=118320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 16:17:51.834325 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-29759f62-bd8c-496b-9787-32bc0a500098 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 952c418c-f36d-47f5-a8b5-ef572ac63dcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5805086-2ebd-4742-8185-f79894fef91e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 16:17:51.945363 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-29759f62-bd8c-496b-9787-32bc0a500098 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550903 Jul 05 16:17:51.946011 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 527/966] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Jul 5 16:17:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 05 16:17:51.956525 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-c2554eb9-38a2-49bb-abef-0f1a9a80ade3 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:17:51.957187 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-c2554eb9-38a2-49bb-abef-0f1a9a80ade3 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 952c418c-f36d-47f5-a8b5-ef572ac63dcb] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:17:52.014245 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c2554eb9-38a2-49bb-abef-0f1a9a80ade3 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41741d00cf04063a21d163842ed5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247d4348634044b9840ae86b7022d72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:17:52.020884 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-c2554eb9-38a2-49bb-abef-0f1a9a80ade3 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "GET /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb" status: 200 len: 1219 microversion: 2.1 time: 0.068216 Jul 05 16:17:52.021899 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 528/967] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:17:51 2022] GET /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:17:53.037790 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-3942617a-6f98-49dd-b7c8-d96dd7f9e2a4 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:17:53.038463 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-3942617a-6f98-49dd-b7c8-d96dd7f9e2a4 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 952c418c-f36d-47f5-a8b5-ef572ac63dcb] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:17:53.045971 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3942617a-6f98-49dd-b7c8-d96dd7f9e2a4 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:53.046421 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3942617a-6f98-49dd-b7c8-d96dd7f9e2a4 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:53.047221 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3942617a-6f98-49dd-b7c8-d96dd7f9e2a4 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:53.047693 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3942617a-6f98-49dd-b7c8-d96dd7f9e2a4 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:53.109362 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-3942617a-6f98-49dd-b7c8-d96dd7f9e2a4 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41741d00cf04063a21d163842ed5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247d4348634044b9840ae86b7022d72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:17:53.117004 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-3942617a-6f98-49dd-b7c8-d96dd7f9e2a4 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "GET /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb" status: 200 len: 1223 microversion: 2.1 time: 0.083066 Jul 05 16:17:53.117574 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 529/968] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:17:53 2022] GET /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:17:54.133762 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-dbd61ff9-77f6-4648-a578-4e2c79b45cac tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:17:54.134378 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-dbd61ff9-77f6-4648-a578-4e2c79b45cac tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 952c418c-f36d-47f5-a8b5-ef572ac63dcb] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:17:54.141609 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dbd61ff9-77f6-4648-a578-4e2c79b45cac tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:54.148231 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dbd61ff9-77f6-4648-a578-4e2c79b45cac tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:54.148231 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dbd61ff9-77f6-4648-a578-4e2c79b45cac tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:54.148231 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dbd61ff9-77f6-4648-a578-4e2c79b45cac tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:54.205394 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-dbd61ff9-77f6-4648-a578-4e2c79b45cac tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41741d00cf04063a21d163842ed5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247d4348634044b9840ae86b7022d72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:17:54.213336 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-dbd61ff9-77f6-4648-a578-4e2c79b45cac tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "GET /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb" status: 200 len: 1289 microversion: 2.1 time: 0.083601 Jul 05 16:17:54.222968 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 530/969] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:17:54 2022] GET /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb => generated 1289 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:17:55.234023 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-48c0eccc-73eb-4829-928b-1845f9530bc0 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:17:55.234704 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-48c0eccc-73eb-4829-928b-1845f9530bc0 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 952c418c-f36d-47f5-a8b5-ef572ac63dcb] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:17:55.241268 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-48c0eccc-73eb-4829-928b-1845f9530bc0 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:55.241721 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-48c0eccc-73eb-4829-928b-1845f9530bc0 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:55.242485 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-48c0eccc-73eb-4829-928b-1845f9530bc0 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:55.242924 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-48c0eccc-73eb-4829-928b-1845f9530bc0 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:55.413406 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-48c0eccc-73eb-4829-928b-1845f9530bc0 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41741d00cf04063a21d163842ed5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247d4348634044b9840ae86b7022d72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:17:55.421250 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-48c0eccc-73eb-4829-928b-1845f9530bc0 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "GET /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb" status: 200 len: 1319 microversion: 2.1 time: 0.191702 Jul 05 16:17:55.421827 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 531/970] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:17:55 2022] GET /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:17:55.801064 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-294d144b-18e0-4ae3-b0c0-5678a7cd51f0 req-ba83b58c-7eba-49f8-b192-a0e78220b9e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "952c418c-f36d-47f5-a8b5-ef572ac63dcb", "tag": "19bc9a9c-19fd-4aeb-bcb1-cb8e3b4e96cc"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:17:55.809299 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-294d144b-18e0-4ae3-b0c0-5678a7cd51f0 req-ba83b58c-7eba-49f8-b192-a0e78220b9e9 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:55.809740 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-294d144b-18e0-4ae3-b0c0-5678a7cd51f0 req-ba83b58c-7eba-49f8-b192-a0e78220b9e9 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:55.821197 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-294d144b-18e0-4ae3-b0c0-5678a7cd51f0 req-ba83b58c-7eba-49f8-b192-a0e78220b9e9 service nova] Creating event network-changed:19bc9a9c-19fd-4aeb-bcb1-cb8e3b4e96cc for instance 952c418c-f36d-47f5-a8b5-ef572ac63dcb on hv-cinder-84875 Jul 05 16:17:55.826248 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-294d144b-18e0-4ae3-b0c0-5678a7cd51f0 req-ba83b58c-7eba-49f8-b192-a0e78220b9e9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028962 Jul 05 16:17:55.826847 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 532/971] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:17:56.439339 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-5dd93cc1-00e7-4ffb-9878-88d2e0970fae tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:17:56.440184 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-5dd93cc1-00e7-4ffb-9878-88d2e0970fae tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 952c418c-f36d-47f5-a8b5-ef572ac63dcb] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:17:56.446643 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5dd93cc1-00e7-4ffb-9878-88d2e0970fae tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:56.447091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5dd93cc1-00e7-4ffb-9878-88d2e0970fae tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:56.447851 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5dd93cc1-00e7-4ffb-9878-88d2e0970fae tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:56.448283 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5dd93cc1-00e7-4ffb-9878-88d2e0970fae tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:56.579565 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-5dd93cc1-00e7-4ffb-9878-88d2e0970fae tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41741d00cf04063a21d163842ed5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247d4348634044b9840ae86b7022d72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:17:56.586989 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-5dd93cc1-00e7-4ffb-9878-88d2e0970fae tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "GET /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb" status: 200 len: 1319 microversion: 2.1 time: 0.151918 Jul 05 16:17:56.587560 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 533/972] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:17:56 2022] GET /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:17:57.603529 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-0a471a9e-fdee-4454-a591-ba9f68eee284 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:17:57.604158 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-0a471a9e-fdee-4454-a591-ba9f68eee284 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 952c418c-f36d-47f5-a8b5-ef572ac63dcb] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:17:57.610847 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0a471a9e-fdee-4454-a591-ba9f68eee284 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:57.611296 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0a471a9e-fdee-4454-a591-ba9f68eee284 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:57.612059 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0a471a9e-fdee-4454-a591-ba9f68eee284 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:57.612534 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0a471a9e-fdee-4454-a591-ba9f68eee284 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:57.744069 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-0a471a9e-fdee-4454-a591-ba9f68eee284 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41741d00cf04063a21d163842ed5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247d4348634044b9840ae86b7022d72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:17:57.751379 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-0a471a9e-fdee-4454-a591-ba9f68eee284 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "GET /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb" status: 200 len: 1319 microversion: 2.1 time: 0.151834 Jul 05 16:17:57.751946 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 534/973] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:17:57 2022] GET /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:17:58.768164 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-1b93a265-bbe0-4a33-8a32-119e086da2fa tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:17:58.768852 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-1b93a265-bbe0-4a33-8a32-119e086da2fa tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 952c418c-f36d-47f5-a8b5-ef572ac63dcb] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:17:58.775255 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1b93a265-bbe0-4a33-8a32-119e086da2fa tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:58.775706 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1b93a265-bbe0-4a33-8a32-119e086da2fa tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:58.776472 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1b93a265-bbe0-4a33-8a32-119e086da2fa tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:58.776952 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1b93a265-bbe0-4a33-8a32-119e086da2fa tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:58.910239 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-1b93a265-bbe0-4a33-8a32-119e086da2fa tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41741d00cf04063a21d163842ed5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247d4348634044b9840ae86b7022d72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:17:58.917605 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-1b93a265-bbe0-4a33-8a32-119e086da2fa tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "GET /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb" status: 200 len: 1319 microversion: 2.1 time: 0.153448 Jul 05 16:17:58.918766 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 535/974] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:17:58 2022] GET /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:17:59.940214 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-8aaddec1-f44f-49f2-817f-d6c9e79b853a tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:17:59.941058 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-8aaddec1-f44f-49f2-817f-d6c9e79b853a tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 952c418c-f36d-47f5-a8b5-ef572ac63dcb] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:17:59.947861 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8aaddec1-f44f-49f2-817f-d6c9e79b853a tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:59.948392 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8aaddec1-f44f-49f2-817f-d6c9e79b853a tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:17:59.949307 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8aaddec1-f44f-49f2-817f-d6c9e79b853a tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:17:59.949752 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8aaddec1-f44f-49f2-817f-d6c9e79b853a tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:00.163771 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-8aaddec1-f44f-49f2-817f-d6c9e79b853a tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41741d00cf04063a21d163842ed5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247d4348634044b9840ae86b7022d72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:18:00.172127 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-8aaddec1-f44f-49f2-817f-d6c9e79b853a tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "GET /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb" status: 200 len: 1319 microversion: 2.1 time: 0.235760 Jul 05 16:18:00.172713 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 536/975] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:17:59 2022] GET /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:18:01.189711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-47becf98-566d-4fe0-928e-090ad5849022 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:18:01.190406 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-47becf98-566d-4fe0-928e-090ad5849022 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 952c418c-f36d-47f5-a8b5-ef572ac63dcb] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:18:01.196959 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-47becf98-566d-4fe0-928e-090ad5849022 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:01.197415 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-47becf98-566d-4fe0-928e-090ad5849022 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:01.198205 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-47becf98-566d-4fe0-928e-090ad5849022 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:01.198647 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-47becf98-566d-4fe0-928e-090ad5849022 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:01.327896 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-47becf98-566d-4fe0-928e-090ad5849022 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41741d00cf04063a21d163842ed5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247d4348634044b9840ae86b7022d72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:18:01.335302 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-47becf98-566d-4fe0-928e-090ad5849022 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "GET /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb" status: 200 len: 1319 microversion: 2.1 time: 0.149574 Jul 05 16:18:01.335913 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 537/976] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:18:01 2022] GET /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:18:01.340828 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-91e14cc7-9987-42d6-b55a-cb1a1626ea0b req-32f55344-1d9a-4aca-8e0b-4607b516ed9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "952c418c-f36d-47f5-a8b5-ef572ac63dcb", "name": "network-vif-plugged", "status": "completed", "tag": "19bc9a9c-19fd-4aeb-bcb1-cb8e3b4e96cc"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:18:01.348384 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-91e14cc7-9987-42d6-b55a-cb1a1626ea0b req-32f55344-1d9a-4aca-8e0b-4607b516ed9c service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:01.348864 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-91e14cc7-9987-42d6-b55a-cb1a1626ea0b req-32f55344-1d9a-4aca-8e0b-4607b516ed9c service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:01.361351 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-91e14cc7-9987-42d6-b55a-cb1a1626ea0b req-32f55344-1d9a-4aca-8e0b-4607b516ed9c service nova] Creating event network-vif-plugged:19bc9a9c-19fd-4aeb-bcb1-cb8e3b4e96cc for instance 952c418c-f36d-47f5-a8b5-ef572ac63dcb on hv-cinder-84875 Jul 05 16:18:01.366190 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-91e14cc7-9987-42d6-b55a-cb1a1626ea0b req-32f55344-1d9a-4aca-8e0b-4607b516ed9c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028658 Jul 05 16:18:01.366786 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 538/977] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:18:02.351974 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-88397f73-73fd-4dc5-9f02-2c49e7468cbb tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:18:02.352616 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-88397f73-73fd-4dc5-9f02-2c49e7468cbb tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 952c418c-f36d-47f5-a8b5-ef572ac63dcb] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:18:02.354616 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell0:SELECT=2 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:18:02.355444 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell0:SELECT=8 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:18:02.360985 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-88397f73-73fd-4dc5-9f02-2c49e7468cbb tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:02.362519 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-88397f73-73fd-4dc5-9f02-2c49e7468cbb tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:02.362519 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-88397f73-73fd-4dc5-9f02-2c49e7468cbb tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:02.362720 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-88397f73-73fd-4dc5-9f02-2c49e7468cbb tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:02.489627 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-88397f73-73fd-4dc5-9f02-2c49e7468cbb tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41741d00cf04063a21d163842ed5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247d4348634044b9840ae86b7022d72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:18:02.497586 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-88397f73-73fd-4dc5-9f02-2c49e7468cbb tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "GET /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb" status: 200 len: 1319 microversion: 2.1 time: 0.149938 Jul 05 16:18:02.498149 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 539/978] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:18:02 2022] GET /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:18:03.514719 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-652e86af-619b-407d-9e9f-a08fb6a69294 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:18:03.515418 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-652e86af-619b-407d-9e9f-a08fb6a69294 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 952c418c-f36d-47f5-a8b5-ef572ac63dcb] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:18:03.522068 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-652e86af-619b-407d-9e9f-a08fb6a69294 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:03.522526 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-652e86af-619b-407d-9e9f-a08fb6a69294 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:03.523299 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-652e86af-619b-407d-9e9f-a08fb6a69294 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:03.523741 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-652e86af-619b-407d-9e9f-a08fb6a69294 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:03.649149 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-652e86af-619b-407d-9e9f-a08fb6a69294 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41741d00cf04063a21d163842ed5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247d4348634044b9840ae86b7022d72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:18:03.657050 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-652e86af-619b-407d-9e9f-a08fb6a69294 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "GET /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb" status: 200 len: 1507 microversion: 2.1 time: 0.146845 Jul 05 16:18:03.657624 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 540/979] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:18:03 2022] GET /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb => generated 1507 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:18:18.947017 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-76924950-61c5-4883-8e31-f34b8abe6e93 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d392ebc1-7c86-429e-8cb3-1f1257f71afd", "device": "/dev/sdb"}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:18:18.948570 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-76924950-61c5-4883-8e31-f34b8abe6e93 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 952c418c-f36d-47f5-a8b5-ef572ac63dcb] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:18:18.950837 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:18:18.951517 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=66 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:18:18.956294 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-76924950-61c5-4883-8e31-f34b8abe6e93 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:18.956742 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-76924950-61c5-4883-8e31-f34b8abe6e93 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:18.957526 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-76924950-61c5-4883-8e31-f34b8abe6e93 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:18.958596 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-76924950-61c5-4883-8e31-f34b8abe6e93 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:19.674509 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-76924950-61c5-4883-8e31-f34b8abe6e93 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "POST /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.731736 Jul 05 16:18:19.675136 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 541/980] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Jul 5 16:18:18 2022] POST /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb/os-volume_attachments => generated 194 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:18:39.282810 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_api:SELECT=2 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:18:39.283579 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:18:39.287852 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-353c5a85-b9fb-469b-a98a-b029071b344f tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:18:39.288481 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-353c5a85-b9fb-469b-a98a-b029071b344f tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:18:39.307788 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-353c5a85-b9fb-469b-a98a-b029071b344f tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:39.307788 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-353c5a85-b9fb-469b-a98a-b029071b344f tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:39.307788 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-353c5a85-b9fb-469b-a98a-b029071b344f tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:39.307788 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-353c5a85-b9fb-469b-a98a-b029071b344f tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:39.318597 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.objects.instance [None req-353c5a85-b9fb-469b-a98a-b029071b344f tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lazy-loading 'flavor' on Instance uuid c0e15bb7-d358-439f-b3bc-697f5c8ee180 {{(pid=118320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 16:18:39.604623 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-353c5a85-b9fb-469b-a98a-b029071b344f tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "POST /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180/action" status: 202 len: 0 microversion: 2.1 time: 0.322912 Jul 05 16:18:39.605305 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 542/981] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Jul 5 16:18:39 2022] POST /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 05 16:18:39.615261 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-9a55864f-3e86-4390-a83d-017b61cb81f2 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:18:39.615974 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-9a55864f-3e86-4390-a83d-017b61cb81f2 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:18:39.623225 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9a55864f-3e86-4390-a83d-017b61cb81f2 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:39.623690 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9a55864f-3e86-4390-a83d-017b61cb81f2 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:39.624589 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9a55864f-3e86-4390-a83d-017b61cb81f2 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:39.625119 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9a55864f-3e86-4390-a83d-017b61cb81f2 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:39.759936 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-9a55864f-3e86-4390-a83d-017b61cb81f2 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:18:39.767397 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-9a55864f-3e86-4390-a83d-017b61cb81f2 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1569 microversion: 2.1 time: 0.157219 Jul 05 16:18:39.767966 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 543/982] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:18:39 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:18:40.784632 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-8ac7eaec-e61b-48f0-b47c-1a74c8570ad1 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:18:40.785308 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-8ac7eaec-e61b-48f0-b47c-1a74c8570ad1 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:18:40.792361 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8ac7eaec-e61b-48f0-b47c-1a74c8570ad1 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:40.792833 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8ac7eaec-e61b-48f0-b47c-1a74c8570ad1 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:40.793598 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8ac7eaec-e61b-48f0-b47c-1a74c8570ad1 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:40.794032 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8ac7eaec-e61b-48f0-b47c-1a74c8570ad1 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:40.926811 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-8ac7eaec-e61b-48f0-b47c-1a74c8570ad1 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:18:40.937061 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-8ac7eaec-e61b-48f0-b47c-1a74c8570ad1 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1569 microversion: 2.1 time: 0.155998 Jul 05 16:18:40.940408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 544/983] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:18:40 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:18:41.954964 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-9982d6b3-db0b-4ba2-85fb-fd13a1d31550 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:18:41.955613 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-9982d6b3-db0b-4ba2-85fb-fd13a1d31550 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:18:41.961901 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9982d6b3-db0b-4ba2-85fb-fd13a1d31550 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:41.962348 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9982d6b3-db0b-4ba2-85fb-fd13a1d31550 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:41.963109 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9982d6b3-db0b-4ba2-85fb-fd13a1d31550 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:41.963540 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9982d6b3-db0b-4ba2-85fb-fd13a1d31550 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:42.094309 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-9982d6b3-db0b-4ba2-85fb-fd13a1d31550 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:18:42.101776 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-9982d6b3-db0b-4ba2-85fb-fd13a1d31550 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1569 microversion: 2.1 time: 0.150626 Jul 05 16:18:42.103015 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 545/984] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:18:41 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:18:43.120603 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-ffe7c185-c087-4037-a8df-a272936670b8 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:18:43.120603 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-ffe7c185-c087-4037-a8df-a272936670b8 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:18:43.126729 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ffe7c185-c087-4037-a8df-a272936670b8 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:43.127119 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ffe7c185-c087-4037-a8df-a272936670b8 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:43.127893 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ffe7c185-c087-4037-a8df-a272936670b8 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:43.128331 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ffe7c185-c087-4037-a8df-a272936670b8 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:43.259109 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-ffe7c185-c087-4037-a8df-a272936670b8 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:18:43.266678 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-ffe7c185-c087-4037-a8df-a272936670b8 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1569 microversion: 2.1 time: 0.151802 Jul 05 16:18:43.267242 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 546/985] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:18:43 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:18:44.157421 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-421df067-c26c-435e-a447-90aa9deec068 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:18:44.157970 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-421df067-c26c-435e-a447-90aa9deec068 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 952c418c-f36d-47f5-a8b5-ef572ac63dcb] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:18:44.164153 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-421df067-c26c-435e-a447-90aa9deec068 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:44.165138 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-421df067-c26c-435e-a447-90aa9deec068 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:44.165893 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-421df067-c26c-435e-a447-90aa9deec068 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:44.166326 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-421df067-c26c-435e-a447-90aa9deec068 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:44.476659 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.objects.instance [None req-421df067-c26c-435e-a447-90aa9deec068 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lazy-loading 'services' on Instance uuid 952c418c-f36d-47f5-a8b5-ef572ac63dcb {{(pid=118320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 16:18:44.671206 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-421df067-c26c-435e-a447-90aa9deec068 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "DELETE /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb/os-volume_attachments/d392ebc1-7c86-429e-8cb3-1f1257f71afd" status: 202 len: 0 microversion: 2.1 time: 0.515285 Jul 05 16:18:44.671206 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 547/986] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Jul 5 16:18:44 2022] DELETE /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb/os-volume_attachments/d392ebc1-7c86-429e-8cb3-1f1257f71afd => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 05 16:18:44.674706 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-37b32fe4-58b7-4c4b-959a-c660584fcd6e tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:18:44.675406 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-37b32fe4-58b7-4c4b-959a-c660584fcd6e tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:18:44.681813 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-37b32fe4-58b7-4c4b-959a-c660584fcd6e tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:44.682271 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-37b32fe4-58b7-4c4b-959a-c660584fcd6e tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:44.683048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-37b32fe4-58b7-4c4b-959a-c660584fcd6e tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:44.683482 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-37b32fe4-58b7-4c4b-959a-c660584fcd6e tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:44.823003 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-37b32fe4-58b7-4c4b-959a-c660584fcd6e tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:18:44.830693 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-37b32fe4-58b7-4c4b-959a-c660584fcd6e tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1569 microversion: 2.1 time: 0.159929 Jul 05 16:18:44.831263 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 548/987] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:18:44 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:18:45.781214 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-5a5998df-5338-45c5-96ed-c2dd3c59eea5 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:18:45.781849 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-5a5998df-5338-45c5-96ed-c2dd3c59eea5 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 952c418c-f36d-47f5-a8b5-ef572ac63dcb] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:18:45.788196 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5a5998df-5338-45c5-96ed-c2dd3c59eea5 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:45.788650 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5a5998df-5338-45c5-96ed-c2dd3c59eea5 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:45.789472 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5a5998df-5338-45c5-96ed-c2dd3c59eea5 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:45.789912 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5a5998df-5338-45c5-96ed-c2dd3c59eea5 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:45.818965 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-5a5998df-5338-45c5-96ed-c2dd3c59eea5 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 952c418c-f36d-47f5-a8b5-ef572ac63dcb] Going to try to terminate instance {{(pid=118320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 16:18:46.098497 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-5a5998df-5338-45c5-96ed-c2dd3c59eea5 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "DELETE /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb" status: 204 len: 0 microversion: 2.1 time: 0.320947 Jul 05 16:18:46.099014 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 549/988] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Jul 5 16:18:45 2022] DELETE /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 05 16:18:46.104065 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-5ffc302e-2db9-4b76-bb30-81d81729693d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:18:46.104787 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-5ffc302e-2db9-4b76-bb30-81d81729693d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:18:46.112395 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5ffc302e-2db9-4b76-bb30-81d81729693d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:46.115824 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5ffc302e-2db9-4b76-bb30-81d81729693d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:46.115824 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5ffc302e-2db9-4b76-bb30-81d81729693d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:46.115824 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5ffc302e-2db9-4b76-bb30-81d81729693d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:46.243772 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-5ffc302e-2db9-4b76-bb30-81d81729693d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:18:46.251306 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-5ffc302e-2db9-4b76-bb30-81d81729693d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1569 microversion: 2.1 time: 0.151195 Jul 05 16:18:46.251878 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 550/989] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:18:46 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:18:46.256306 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-b8844b77-64ac-4b99-8ad7-5b9e08bf5c2a tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:18:46.256944 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-b8844b77-64ac-4b99-8ad7-5b9e08bf5c2a tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 952c418c-f36d-47f5-a8b5-ef572ac63dcb] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:18:46.263027 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b8844b77-64ac-4b99-8ad7-5b9e08bf5c2a tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:46.263484 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b8844b77-64ac-4b99-8ad7-5b9e08bf5c2a tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:46.264249 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b8844b77-64ac-4b99-8ad7-5b9e08bf5c2a tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:46.264689 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b8844b77-64ac-4b99-8ad7-5b9e08bf5c2a tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:46.391767 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-b8844b77-64ac-4b99-8ad7-5b9e08bf5c2a tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41741d00cf04063a21d163842ed5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247d4348634044b9840ae86b7022d72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:18:46.399291 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-b8844b77-64ac-4b99-8ad7-5b9e08bf5c2a tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "GET /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb" status: 200 len: 1513 microversion: 2.1 time: 0.146480 Jul 05 16:18:46.399991 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 551/990] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:18:46 2022] GET /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:18:47.269104 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-b0da42e3-1196-4f5f-a921-2963149a52f8 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:18:47.269718 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-b0da42e3-1196-4f5f-a921-2963149a52f8 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:18:47.276934 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b0da42e3-1196-4f5f-a921-2963149a52f8 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:47.277404 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b0da42e3-1196-4f5f-a921-2963149a52f8 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:47.278158 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b0da42e3-1196-4f5f-a921-2963149a52f8 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:47.278744 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b0da42e3-1196-4f5f-a921-2963149a52f8 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:47.412341 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-b0da42e3-1196-4f5f-a921-2963149a52f8 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:18:47.420107 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-b0da42e3-1196-4f5f-a921-2963149a52f8 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1569 microversion: 2.1 time: 0.155134 Jul 05 16:18:47.422731 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 552/991] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:18:47 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:18:47.426287 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-ad4412e4-3da1-4615-bb6c-ce720f9033b9 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:18:47.426984 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-ad4412e4-3da1-4615-bb6c-ce720f9033b9 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 952c418c-f36d-47f5-a8b5-ef572ac63dcb] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:18:47.433669 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ad4412e4-3da1-4615-bb6c-ce720f9033b9 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:47.434128 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ad4412e4-3da1-4615-bb6c-ce720f9033b9 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:47.434906 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ad4412e4-3da1-4615-bb6c-ce720f9033b9 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:47.435350 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ad4412e4-3da1-4615-bb6c-ce720f9033b9 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:47.567102 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-ad4412e4-3da1-4615-bb6c-ce720f9033b9 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41741d00cf04063a21d163842ed5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247d4348634044b9840ae86b7022d72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:18:47.575215 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-ad4412e4-3da1-4615-bb6c-ce720f9033b9 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "GET /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb" status: 200 len: 1513 microversion: 2.1 time: 0.153526 Jul 05 16:18:47.575789 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 553/992] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:18:47 2022] GET /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:18:48.250411 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-b054cfd3-1e77-4360-a659-84344102e072 req-58d5f875-12be-4942-8183-06d2b65bc1ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "952c418c-f36d-47f5-a8b5-ef572ac63dcb", "name": "network-vif-deleted", "tag": "19bc9a9c-19fd-4aeb-bcb1-cb8e3b4e96cc"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:18:48.258577 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-b054cfd3-1e77-4360-a659-84344102e072 req-58d5f875-12be-4942-8183-06d2b65bc1ea service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:48.259023 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-b054cfd3-1e77-4360-a659-84344102e072 req-58d5f875-12be-4942-8183-06d2b65bc1ea service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:48.263674 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:18:48.271037 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-b054cfd3-1e77-4360-a659-84344102e072 req-58d5f875-12be-4942-8183-06d2b65bc1ea service nova] Creating event network-vif-deleted:19bc9a9c-19fd-4aeb-bcb1-cb8e3b4e96cc for instance 952c418c-f36d-47f5-a8b5-ef572ac63dcb on hv-cinder-84875 Jul 05 16:18:48.276800 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-b054cfd3-1e77-4360-a659-84344102e072 req-58d5f875-12be-4942-8183-06d2b65bc1ea service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030396 Jul 05 16:18:48.277169 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 554/993] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:18:48.437083 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-369f008c-aea2-4b9c-b379-5a886397f77a tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:18:48.437796 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-369f008c-aea2-4b9c-b379-5a886397f77a tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:18:48.444747 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-369f008c-aea2-4b9c-b379-5a886397f77a tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:48.445210 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-369f008c-aea2-4b9c-b379-5a886397f77a tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:48.445974 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-369f008c-aea2-4b9c-b379-5a886397f77a tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:48.446411 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-369f008c-aea2-4b9c-b379-5a886397f77a tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:48.578544 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-369f008c-aea2-4b9c-b379-5a886397f77a tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:18:48.587738 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-369f008c-aea2-4b9c-b379-5a886397f77a tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1569 microversion: 2.1 time: 0.154670 Jul 05 16:18:48.588094 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 555/994] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:18:48 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:18:48.592654 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-ac8da482-963f-4fc0-883f-b7a5260a19dc tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:18:48.593291 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-ac8da482-963f-4fc0-883f-b7a5260a19dc tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 952c418c-f36d-47f5-a8b5-ef572ac63dcb] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:18:48.598966 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ac8da482-963f-4fc0-883f-b7a5260a19dc tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:48.599410 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ac8da482-963f-4fc0-883f-b7a5260a19dc tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:48.600166 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ac8da482-963f-4fc0-883f-b7a5260a19dc tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:48.600598 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ac8da482-963f-4fc0-883f-b7a5260a19dc tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:48.631055 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ac8da482-963f-4fc0-883f-b7a5260a19dc tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:48.631539 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ac8da482-963f-4fc0-883f-b7a5260a19dc tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:48.632026 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.objects.instance [None req-ac8da482-963f-4fc0-883f-b7a5260a19dc tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lazy-loading 'fault' on Instance uuid 952c418c-f36d-47f5-a8b5-ef572ac63dcb {{(pid=118320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 16:18:48.675962 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-ac8da482-963f-4fc0-883f-b7a5260a19dc tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41741d00cf04063a21d163842ed5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247d4348634044b9840ae86b7022d72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:18:48.683445 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-ac8da482-963f-4fc0-883f-b7a5260a19dc tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "GET /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb" status: 200 len: 1309 microversion: 2.1 time: 0.094368 Jul 05 16:18:48.684038 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 556/995] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:18:48 2022] GET /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:18:49.605063 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-fec13b1e-0503-48e7-86b0-c7c36dd8de82 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:18:49.605696 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-fec13b1e-0503-48e7-86b0-c7c36dd8de82 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:18:49.612424 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fec13b1e-0503-48e7-86b0-c7c36dd8de82 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:49.612907 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fec13b1e-0503-48e7-86b0-c7c36dd8de82 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:49.613670 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fec13b1e-0503-48e7-86b0-c7c36dd8de82 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:49.614113 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-fec13b1e-0503-48e7-86b0-c7c36dd8de82 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:49.743034 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-fec13b1e-0503-48e7-86b0-c7c36dd8de82 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:18:49.750472 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-fec13b1e-0503-48e7-86b0-c7c36dd8de82 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1569 microversion: 2.1 time: 0.149922 Jul 05 16:18:49.751039 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 557/996] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:18:49 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:18:49.755336 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-9784cd06-f6a5-4410-8711-ecf23e271d07 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:18:49.755947 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-9784cd06-f6a5-4410-8711-ecf23e271d07 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 952c418c-f36d-47f5-a8b5-ef572ac63dcb] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:18:49.761484 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9784cd06-f6a5-4410-8711-ecf23e271d07 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:49.761935 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9784cd06-f6a5-4410-8711-ecf23e271d07 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:49.762694 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9784cd06-f6a5-4410-8711-ecf23e271d07 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:49.763130 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9784cd06-f6a5-4410-8711-ecf23e271d07 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:49.776463 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-9784cd06-f6a5-4410-8711-ecf23e271d07 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] HTTP exception thrown: Instance 952c418c-f36d-47f5-a8b5-ef572ac63dcb could not be found. Jul 05 16:18:49.778113 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-9784cd06-f6a5-4410-8711-ecf23e271d07 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Request method failure captured: Jul 05 16:18:49.778113 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: GET /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb HTTP/1.1 Jul 05 16:18:49.778113 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:18:49.778113 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:18:49.778113 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:18:49.778113 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:18:49.778113 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:18:49.778113 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:18:49.778113 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:18:49.778113 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:18:49.778113 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGQtK55GZgkvTnkGPOny1JSAx91Tc0DXBpQIFwSuhRjrKAFsBoYNnD0mTw9w58P8nTlF66WQUCoi-xout772XAGUK_wr4Whsxo6pDblhMg6-Dum4Z1G4tbyls4biDFn4MPHmG2myoamwX_dO79o3wgWMpW0OodM9bRY-xwz7iqToOKs Jul 05 16:18:49.778113 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:18:49.778113 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:18:49.778113 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:18:49.778113 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:18:49.778113 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:18:49.778113 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:18:49.778113 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 247d4348634044b9840ae86b7022d72c Jul 05 16:18:49.778113 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1396655489 Jul 05 16:18:49.778113 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:18:49.778113 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:18:49.779851 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_247d4348634044b9840ae86b7022d72c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/247d4348634044b9840ae86b7022d72c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/247d4348634044b9840ae86b7022d72c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/247d4348634044b9840ae86b7022d72c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:18:49.779851 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-VolumesSnapshotTestJSON-1396655489 Jul 05 16:18:49.779851 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 247d4348634044b9840ae86b7022d72c Jul 05 16:18:49.779851 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1396655489 Jul 05 16:18:49.779851 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-VolumesSnapshotTestJSON-1396655489-project Jul 05 16:18:49.779851 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:18:49.779851 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:18:49.779851 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: e41741d00cf04063a21d163842ed5abe Jul 05 16:18:49.779851 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-VolumesSnapshotTestJSON-1396655489-project Jul 05 16:18:49.779851 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:18:49.779851 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance 952c418c-f36d-47f5-a8b5-ef572ac63dcb could not be found. Jul 05 16:18:49.779851 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': '952c418c-f36d-47f5-a8b5-ef572ac63dcb'} Jul 05 16:18:49.781101 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:18:49.781101 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:18:49.781101 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:18:49.781101 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:18:49.781101 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:18:49.781101 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:18:49.781101 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:18:49.781101 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:18:49.781101 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:18:49.781101 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:18:49.781101 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 952c418c-f36d-47f5-a8b5-ef572ac63dcb could not be found. Jul 05 16:18:49.781101 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:18:49.781101 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:18:49.781101 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:18:49.781101 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:18:49.781101 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:18:49.781101 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:18:49.781101 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:18:49.781101 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:18:49.781101 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:18:49.782655 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:18:49.782655 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 16:18:49.782655 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 16:18:49.782655 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:18:49.782655 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:18:49.782655 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:18:49.782655 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:18:49.782655 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 952c418c-f36d-47f5-a8b5-ef572ac63dcb could not be found. Jul 05 16:18:49.782655 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:18:49.782655 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:18:49.782655 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:18:49.782655 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:18:49.782655 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:18:49.782655 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:18:49.782655 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:18:49.782655 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:18:49.782655 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 952c418c-f36d-47f5-a8b5-ef572ac63dcb could not be found. Jul 05 16:18:49.782655 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:18:49.784029 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-9784cd06-f6a5-4410-8711-ecf23e271d07 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Returning 404 to user: Instance 952c418c-f36d-47f5-a8b5-ef572ac63dcb could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:18:49.784029 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-9784cd06-f6a5-4410-8711-ecf23e271d07 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "GET /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb" status: 404 len: 111 microversion: 2.1 time: 0.027527 Jul 05 16:18:49.784029 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 558/997] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:18:49 2022] GET /compute/v2.1/servers/952c418c-f36d-47f5-a8b5-ef572ac63dcb => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 16:18:50.767480 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-28d3989b-45f9-49ec-9e15-a38a71f7e24c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:18:50.768153 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-28d3989b-45f9-49ec-9e15-a38a71f7e24c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:18:50.774668 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-28d3989b-45f9-49ec-9e15-a38a71f7e24c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:50.775122 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-28d3989b-45f9-49ec-9e15-a38a71f7e24c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:50.775894 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-28d3989b-45f9-49ec-9e15-a38a71f7e24c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:50.776334 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-28d3989b-45f9-49ec-9e15-a38a71f7e24c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:50.905369 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-28d3989b-45f9-49ec-9e15-a38a71f7e24c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:18:50.912865 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-28d3989b-45f9-49ec-9e15-a38a71f7e24c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1569 microversion: 2.1 time: 0.149252 Jul 05 16:18:50.913421 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 559/998] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:18:50 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:18:51.931364 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-cea41588-9a16-40a7-9af2-84490d67c685 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:18:51.932016 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-cea41588-9a16-40a7-9af2-84490d67c685 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:18:51.938464 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-cea41588-9a16-40a7-9af2-84490d67c685 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:51.938918 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-cea41588-9a16-40a7-9af2-84490d67c685 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:51.939688 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-cea41588-9a16-40a7-9af2-84490d67c685 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:51.940125 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-cea41588-9a16-40a7-9af2-84490d67c685 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:52.073781 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-cea41588-9a16-40a7-9af2-84490d67c685 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:18:52.081243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-cea41588-9a16-40a7-9af2-84490d67c685 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1569 microversion: 2.1 time: 0.154326 Jul 05 16:18:52.081818 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 560/999] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:18:51 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:18:53.098841 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-2b5f8901-b960-48b4-98d2-13263c59e79e tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:18:53.099516 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-2b5f8901-b960-48b4-98d2-13263c59e79e tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:18:53.106016 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2b5f8901-b960-48b4-98d2-13263c59e79e tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:53.106463 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2b5f8901-b960-48b4-98d2-13263c59e79e tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:53.107234 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2b5f8901-b960-48b4-98d2-13263c59e79e tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:53.107675 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-2b5f8901-b960-48b4-98d2-13263c59e79e tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:53.236152 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-2b5f8901-b960-48b4-98d2-13263c59e79e tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:18:53.243605 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-2b5f8901-b960-48b4-98d2-13263c59e79e tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1569 microversion: 2.1 time: 0.148785 Jul 05 16:18:53.244183 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 561/1000] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:18:53 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:18:54.262033 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-4a9cb33d-acba-446a-a087-5c235bc87884 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:18:54.263472 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-4a9cb33d-acba-446a-a087-5c235bc87884 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:18:54.271166 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4a9cb33d-acba-446a-a087-5c235bc87884 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:54.271720 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4a9cb33d-acba-446a-a087-5c235bc87884 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:54.272724 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4a9cb33d-acba-446a-a087-5c235bc87884 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:54.273265 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4a9cb33d-acba-446a-a087-5c235bc87884 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:54.407680 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-4a9cb33d-acba-446a-a087-5c235bc87884 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:18:54.415086 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-4a9cb33d-acba-446a-a087-5c235bc87884 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1570 microversion: 2.1 time: 0.157598 Jul 05 16:18:54.415653 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 562/1001] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:18:54 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:18:54.431308 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-ea7d50af-2080-4ed7-ac33-4557486ac1c9 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:18:54.431875 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-ea7d50af-2080-4ed7-ac33-4557486ac1c9 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:18:54.437576 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ea7d50af-2080-4ed7-ac33-4557486ac1c9 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:54.438084 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ea7d50af-2080-4ed7-ac33-4557486ac1c9 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:54.438794 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ea7d50af-2080-4ed7-ac33-4557486ac1c9 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:54.439225 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ea7d50af-2080-4ed7-ac33-4557486ac1c9 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:54.642312 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-ea7d50af-2080-4ed7-ac33-4557486ac1c9 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "POST /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180/action" status: 202 len: 0 microversion: 2.1 time: 0.215093 Jul 05 16:18:54.642938 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 563/1002] 10.222.0.45 () {60 vars in 1277 bytes} [Tue Jul 5 16:18:54 2022] POST /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 05 16:18:54.650857 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-005dcc83-c386-41c9-b05c-cfa6eb442bb0 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:18:54.651476 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-005dcc83-c386-41c9-b05c-cfa6eb442bb0 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:18:54.661866 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-005dcc83-c386-41c9-b05c-cfa6eb442bb0 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:54.661866 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-005dcc83-c386-41c9-b05c-cfa6eb442bb0 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:54.661866 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-005dcc83-c386-41c9-b05c-cfa6eb442bb0 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:54.661866 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-005dcc83-c386-41c9-b05c-cfa6eb442bb0 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:54.836159 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-005dcc83-c386-41c9-b05c-cfa6eb442bb0 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:18:54.846735 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-005dcc83-c386-41c9-b05c-cfa6eb442bb0 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1578 microversion: 2.1 time: 0.199551 Jul 05 16:18:54.847865 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 564/1003] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:18:54 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1578 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:18:55.453794 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-fdedb9bf-e8fe-42ff-94c3-cc8d7004f6ae req-be0ed289-9fe3-4609-b6c2-00933f8ef7de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e15bb7-d358-439f-b3bc-697f5c8ee180", "name": "network-vif-unplugged", "status": "completed", "tag": "f472f8e8-76d0-4068-af84-5901b45f5f21"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:18:55.462943 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-fdedb9bf-e8fe-42ff-94c3-cc8d7004f6ae req-be0ed289-9fe3-4609-b6c2-00933f8ef7de service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:55.463377 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-fdedb9bf-e8fe-42ff-94c3-cc8d7004f6ae req-be0ed289-9fe3-4609-b6c2-00933f8ef7de service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:55.474225 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.compute.server_external_events [req-fdedb9bf-e8fe-42ff-94c3-cc8d7004f6ae req-be0ed289-9fe3-4609-b6c2-00933f8ef7de service nova] Unable to find a host for instance c0e15bb7-d358-439f-b3bc-697f5c8ee180. Dropping event network-vif-unplugged {{(pid=118320) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 05 16:18:55.475132 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-fdedb9bf-e8fe-42ff-94c3-cc8d7004f6ae req-be0ed289-9fe3-4609-b6c2-00933f8ef7de service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025254 Jul 05 16:18:55.475710 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 565/1004] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 05 16:18:55.864226 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-91d32382-457e-4145-b7f1-775f64e321ab tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:18:55.864800 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-91d32382-457e-4145-b7f1-775f64e321ab tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:18:55.871383 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-91d32382-457e-4145-b7f1-775f64e321ab tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:55.871835 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-91d32382-457e-4145-b7f1-775f64e321ab tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:55.872606 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-91d32382-457e-4145-b7f1-775f64e321ab tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:55.873079 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-91d32382-457e-4145-b7f1-775f64e321ab tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:55.999118 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-91d32382-457e-4145-b7f1-775f64e321ab tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:18:56.006517 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-91d32382-457e-4145-b7f1-775f64e321ab tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1520 microversion: 2.1 time: 0.146492 Jul 05 16:18:56.007087 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 566/1005] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:18:55 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:18:57.023877 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-e7bbeaa2-649c-488f-b120-7ccfa1861f30 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:18:57.024572 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-e7bbeaa2-649c-488f-b120-7ccfa1861f30 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:18:57.030950 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e7bbeaa2-649c-488f-b120-7ccfa1861f30 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:57.032190 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e7bbeaa2-649c-488f-b120-7ccfa1861f30 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:57.032190 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e7bbeaa2-649c-488f-b120-7ccfa1861f30 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:57.032545 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e7bbeaa2-649c-488f-b120-7ccfa1861f30 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:57.163054 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-e7bbeaa2-649c-488f-b120-7ccfa1861f30 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:18:57.171412 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-e7bbeaa2-649c-488f-b120-7ccfa1861f30 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1520 microversion: 2.1 time: 0.151430 Jul 05 16:18:57.171980 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 567/1006] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:18:57 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:18:58.183167 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-e26ae3be-c379-4f5d-81a2-93c7a15e3a83 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1619081860", "imageRef": "c5805086-2ebd-4742-8185-f79894fef91e", "flavorRef": "452", "networks": [{"uuid": "9842c0a5-0f39-435c-a75f-f8cd01594524"}]}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:18:58.234021 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.network.neutron [None req-e26ae3be-c379-4f5d-81a2-93c7a15e3a83 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] validate_networks() for [('9842c0a5-0f39-435c-a75f-f8cd01594524', None, None, None, None, None)] {{(pid=118320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 16:18:58.594300 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-e26ae3be-c379-4f5d-81a2-93c7a15e3a83 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Flavor limits 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 16:18:58.594788 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-e26ae3be-c379-4f5d-81a2-93c7a15e3a83 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Image limits 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 16:18:58.595356 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-e26ae3be-c379-4f5d-81a2-93c7a15e3a83 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Flavor pref 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 16:18:58.595842 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-e26ae3be-c379-4f5d-81a2-93c7a15e3a83 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Image pref 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 16:18:58.596359 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-e26ae3be-c379-4f5d-81a2-93c7a15e3a83 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 16:18:58.605627 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e26ae3be-c379-4f5d-81a2-93c7a15e3a83 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:58.606072 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e26ae3be-c379-4f5d-81a2-93c7a15e3a83 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:58.606856 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e26ae3be-c379-4f5d-81a2-93c7a15e3a83 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:58.607287 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e26ae3be-c379-4f5d-81a2-93c7a15e3a83 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:58.625007 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-e26ae3be-c379-4f5d-81a2-93c7a15e3a83 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Getting quotas for project 247d4348634044b9840ae86b7022d72c. Resources: {'ram', 'instances', 'cores'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:18:58.629007 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-e26ae3be-c379-4f5d-81a2-93c7a15e3a83 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Getting quotas for user e41741d00cf04063a21d163842ed5abe and project 247d4348634044b9840ae86b7022d72c. Resources: {'ram', 'instances', 'cores'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:18:58.639949 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-e26ae3be-c379-4f5d-81a2-93c7a15e3a83 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Going to run 1 instances... {{(pid=118320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 16:18:58.642203 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-e26ae3be-c379-4f5d-81a2-93c7a15e3a83 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 3e4bf9d8-4639-4c1d-92b9-112272598680] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5805086-2ebd-4742-8185-f79894fef91e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 16:18:58.818378 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-e26ae3be-c379-4f5d-81a2-93c7a15e3a83 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.639716 Jul 05 16:18:58.821158 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 568/1007] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Jul 5 16:18:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 05 16:18:58.824579 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-358f1051-b56f-485b-94fd-a504426e6026 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:18:58.825286 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-358f1051-b56f-485b-94fd-a504426e6026 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:18:58.831593 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-358f1051-b56f-485b-94fd-a504426e6026 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:58.832048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-358f1051-b56f-485b-94fd-a504426e6026 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:58.832850 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-358f1051-b56f-485b-94fd-a504426e6026 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:18:58.833321 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-358f1051-b56f-485b-94fd-a504426e6026 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:18:58.975032 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-358f1051-b56f-485b-94fd-a504426e6026 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:18:58.983409 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-358f1051-b56f-485b-94fd-a504426e6026 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1520 microversion: 2.1 time: 0.163130 Jul 05 16:18:58.983974 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 569/1008] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:18:58 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:18:58.989080 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-c527c670-98cd-4ab4-a3d7-b4218cb0a3b1 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:18:58.990239 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-c527c670-98cd-4ab4-a3d7-b4218cb0a3b1 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 3e4bf9d8-4639-4c1d-92b9-112272598680] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:18:59.054663 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c527c670-98cd-4ab4-a3d7-b4218cb0a3b1 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41741d00cf04063a21d163842ed5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247d4348634044b9840ae86b7022d72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:18:59.063266 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-c527c670-98cd-4ab4-a3d7-b4218cb0a3b1 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "GET /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680" status: 200 len: 1219 microversion: 2.1 time: 0.078279 Jul 05 16:18:59.063866 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 570/1009] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:18:58 2022] GET /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:19:00.001675 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-26b0d5f6-96e3-4c7b-b6f3-a0b5438f5c60 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:19:00.002295 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-26b0d5f6-96e3-4c7b-b6f3-a0b5438f5c60 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:19:00.008884 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-26b0d5f6-96e3-4c7b-b6f3-a0b5438f5c60 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:00.009341 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-26b0d5f6-96e3-4c7b-b6f3-a0b5438f5c60 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:00.010121 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-26b0d5f6-96e3-4c7b-b6f3-a0b5438f5c60 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:00.010563 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-26b0d5f6-96e3-4c7b-b6f3-a0b5438f5c60 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:00.184866 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-26b0d5f6-96e3-4c7b-b6f3-a0b5438f5c60 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:19:00.192578 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-26b0d5f6-96e3-4c7b-b6f3-a0b5438f5c60 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1576 microversion: 2.1 time: 0.194826 Jul 05 16:19:00.193177 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 571/1010] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:18:59 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1576 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:19:00.198179 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-28cc3f11-131d-4ae9-9454-f23ae21fb41e tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:19:00.198918 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-28cc3f11-131d-4ae9-9454-f23ae21fb41e tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 3e4bf9d8-4639-4c1d-92b9-112272598680] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:19:00.204547 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-28cc3f11-131d-4ae9-9454-f23ae21fb41e tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:00.205110 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-28cc3f11-131d-4ae9-9454-f23ae21fb41e tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:00.205881 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-28cc3f11-131d-4ae9-9454-f23ae21fb41e tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:00.206329 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-28cc3f11-131d-4ae9-9454-f23ae21fb41e tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:00.267151 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-28cc3f11-131d-4ae9-9454-f23ae21fb41e tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41741d00cf04063a21d163842ed5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247d4348634044b9840ae86b7022d72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:19:00.274926 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-28cc3f11-131d-4ae9-9454-f23ae21fb41e tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "GET /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680" status: 200 len: 1271 microversion: 2.1 time: 0.080766 Jul 05 16:19:00.275508 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 572/1011] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:19:00 2022] GET /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680 => generated 1271 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:19:00.710564 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 16:19:00.711737 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Tue Jul 5 16:19:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 (ip 10.222.0.45) !!! Jul 05 16:19:01.210279 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-c3b3fc80-2aa3-4fcb-bece-13b34ef257a3 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:19:01.211001 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-c3b3fc80-2aa3-4fcb-bece-13b34ef257a3 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:19:01.217778 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c3b3fc80-2aa3-4fcb-bece-13b34ef257a3 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:01.218203 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c3b3fc80-2aa3-4fcb-bece-13b34ef257a3 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:01.218984 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c3b3fc80-2aa3-4fcb-bece-13b34ef257a3 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:01.219429 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c3b3fc80-2aa3-4fcb-bece-13b34ef257a3 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:01.223637 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:01.407598 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c3b3fc80-2aa3-4fcb-bece-13b34ef257a3 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:19:01.415659 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-c3b3fc80-2aa3-4fcb-bece-13b34ef257a3 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1576 microversion: 2.1 time: 0.209230 Jul 05 16:19:01.416237 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 573/1012] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:19:01 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1576 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:19:01.420802 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-3a26fe69-e7e8-4c58-9e83-cfe5e7b11012 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:19:01.421501 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-3a26fe69-e7e8-4c58-9e83-cfe5e7b11012 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 3e4bf9d8-4639-4c1d-92b9-112272598680] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:19:01.428672 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3a26fe69-e7e8-4c58-9e83-cfe5e7b11012 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:01.429149 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3a26fe69-e7e8-4c58-9e83-cfe5e7b11012 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:01.429940 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3a26fe69-e7e8-4c58-9e83-cfe5e7b11012 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:01.430385 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3a26fe69-e7e8-4c58-9e83-cfe5e7b11012 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:01.500267 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-3a26fe69-e7e8-4c58-9e83-cfe5e7b11012 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41741d00cf04063a21d163842ed5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247d4348634044b9840ae86b7022d72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:19:01.508575 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-3a26fe69-e7e8-4c58-9e83-cfe5e7b11012 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "GET /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680" status: 200 len: 1277 microversion: 2.1 time: 0.090796 Jul 05 16:19:01.509389 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 574/1013] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:19:01 2022] GET /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680 => generated 1277 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:19:02.433380 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-82630013-9505-42be-9fb9-e00f0eb93196 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:19:02.433993 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-82630013-9505-42be-9fb9-e00f0eb93196 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:19:02.440474 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-82630013-9505-42be-9fb9-e00f0eb93196 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:02.440969 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-82630013-9505-42be-9fb9-e00f0eb93196 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:02.441751 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-82630013-9505-42be-9fb9-e00f0eb93196 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:02.442228 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-82630013-9505-42be-9fb9-e00f0eb93196 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:02.715426 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-82630013-9505-42be-9fb9-e00f0eb93196 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:19:02.723114 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-82630013-9505-42be-9fb9-e00f0eb93196 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1576 microversion: 2.1 time: 0.294137 Jul 05 16:19:02.723688 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 575/1014] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:19:02 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1576 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:19:02.729245 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-8a865794-ae97-447a-85be-9ef532d35fb4 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:19:02.729773 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-8a865794-ae97-447a-85be-9ef532d35fb4 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 3e4bf9d8-4639-4c1d-92b9-112272598680] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:19:02.736039 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8a865794-ae97-447a-85be-9ef532d35fb4 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:02.736507 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8a865794-ae97-447a-85be-9ef532d35fb4 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:02.743392 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8a865794-ae97-447a-85be-9ef532d35fb4 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:02.743392 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8a865794-ae97-447a-85be-9ef532d35fb4 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:02.899300 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-8a865794-ae97-447a-85be-9ef532d35fb4 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41741d00cf04063a21d163842ed5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247d4348634044b9840ae86b7022d72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:19:02.906716 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-8a865794-ae97-447a-85be-9ef532d35fb4 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "GET /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680" status: 200 len: 1319 microversion: 2.1 time: 0.182027 Jul 05 16:19:02.907288 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 576/1015] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:19:02 2022] GET /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:19:02.982038 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-106269a0-289d-4a62-92ef-eacc83f090e4 req-7ccf02ea-1333-4d19-b948-1dbf7e4cf218 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e4bf9d8-4639-4c1d-92b9-112272598680", "tag": "6b1d876a-a238-4efc-bf3b-29b75958d783"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:19:02.990649 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-106269a0-289d-4a62-92ef-eacc83f090e4 req-7ccf02ea-1333-4d19-b948-1dbf7e4cf218 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:02.991097 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-106269a0-289d-4a62-92ef-eacc83f090e4 req-7ccf02ea-1333-4d19-b948-1dbf7e4cf218 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:03.002345 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-106269a0-289d-4a62-92ef-eacc83f090e4 req-7ccf02ea-1333-4d19-b948-1dbf7e4cf218 service nova] Creating event network-changed:6b1d876a-a238-4efc-bf3b-29b75958d783 for instance 3e4bf9d8-4639-4c1d-92b9-112272598680 on hv-cinder-84875 Jul 05 16:19:03.007145 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-106269a0-289d-4a62-92ef-eacc83f090e4 req-7ccf02ea-1333-4d19-b948-1dbf7e4cf218 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029145 Jul 05 16:19:03.011600 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 577/1016] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:19:03.742472 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-c73025ca-fc10-4ba3-a4f9-89fcb5d55b29 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:19:03.743173 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-c73025ca-fc10-4ba3-a4f9-89fcb5d55b29 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:19:03.746153 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:03.749760 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c73025ca-fc10-4ba3-a4f9-89fcb5d55b29 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:03.750207 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c73025ca-fc10-4ba3-a4f9-89fcb5d55b29 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:03.750961 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c73025ca-fc10-4ba3-a4f9-89fcb5d55b29 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:03.751443 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c73025ca-fc10-4ba3-a4f9-89fcb5d55b29 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:03.883746 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c73025ca-fc10-4ba3-a4f9-89fcb5d55b29 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:19:03.891294 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-c73025ca-fc10-4ba3-a4f9-89fcb5d55b29 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1576 microversion: 2.1 time: 0.153682 Jul 05 16:19:03.891869 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 578/1017] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:19:03 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:19:03.922890 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-538dd5c3-9f64-43d5-a540-1ce3b16f73a4 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:19:03.923506 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-538dd5c3-9f64-43d5-a540-1ce3b16f73a4 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 3e4bf9d8-4639-4c1d-92b9-112272598680] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:19:03.929365 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-538dd5c3-9f64-43d5-a540-1ce3b16f73a4 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:03.929823 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-538dd5c3-9f64-43d5-a540-1ce3b16f73a4 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:03.930615 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-538dd5c3-9f64-43d5-a540-1ce3b16f73a4 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:03.931057 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-538dd5c3-9f64-43d5-a540-1ce3b16f73a4 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:04.061345 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-538dd5c3-9f64-43d5-a540-1ce3b16f73a4 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41741d00cf04063a21d163842ed5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247d4348634044b9840ae86b7022d72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:19:04.068628 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-538dd5c3-9f64-43d5-a540-1ce3b16f73a4 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "GET /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680" status: 200 len: 1319 microversion: 2.1 time: 0.149353 Jul 05 16:19:04.069810 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 579/1018] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:19:03 2022] GET /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:19:04.908847 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-67df7e51-9587-416e-bdc1-ea5eaf24d896 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:19:04.909472 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-67df7e51-9587-416e-bdc1-ea5eaf24d896 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:19:04.916623 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-67df7e51-9587-416e-bdc1-ea5eaf24d896 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:04.917097 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-67df7e51-9587-416e-bdc1-ea5eaf24d896 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:04.917860 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-67df7e51-9587-416e-bdc1-ea5eaf24d896 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:04.918302 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-67df7e51-9587-416e-bdc1-ea5eaf24d896 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:05.054991 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-67df7e51-9587-416e-bdc1-ea5eaf24d896 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:19:05.062425 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-67df7e51-9587-416e-bdc1-ea5eaf24d896 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1576 microversion: 2.1 time: 0.157541 Jul 05 16:19:05.063031 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 580/1019] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:19:04 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:19:05.084199 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-3c6398c4-ba9c-4b34-861a-b7cd1d03c288 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:19:05.084839 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-3c6398c4-ba9c-4b34-861a-b7cd1d03c288 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 3e4bf9d8-4639-4c1d-92b9-112272598680] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:19:05.091352 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3c6398c4-ba9c-4b34-861a-b7cd1d03c288 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:05.097834 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3c6398c4-ba9c-4b34-861a-b7cd1d03c288 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:05.097834 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3c6398c4-ba9c-4b34-861a-b7cd1d03c288 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:05.097834 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3c6398c4-ba9c-4b34-861a-b7cd1d03c288 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:05.230634 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-3c6398c4-ba9c-4b34-861a-b7cd1d03c288 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41741d00cf04063a21d163842ed5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247d4348634044b9840ae86b7022d72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:19:05.241023 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-3c6398c4-ba9c-4b34-861a-b7cd1d03c288 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "GET /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680" status: 200 len: 1319 microversion: 2.1 time: 0.158035 Jul 05 16:19:05.241023 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 581/1020] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:19:05 2022] GET /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:19:06.080205 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-74a5f99a-89e8-4720-b4e5-6e9fbeabd07d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:19:06.080895 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-74a5f99a-89e8-4720-b4e5-6e9fbeabd07d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:19:06.087860 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-74a5f99a-89e8-4720-b4e5-6e9fbeabd07d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:06.088310 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-74a5f99a-89e8-4720-b4e5-6e9fbeabd07d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:06.089103 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-74a5f99a-89e8-4720-b4e5-6e9fbeabd07d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:06.089547 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-74a5f99a-89e8-4720-b4e5-6e9fbeabd07d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:06.217669 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-74a5f99a-89e8-4720-b4e5-6e9fbeabd07d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:19:06.225150 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-74a5f99a-89e8-4720-b4e5-6e9fbeabd07d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1576 microversion: 2.1 time: 0.148818 Jul 05 16:19:06.225720 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 582/1021] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:19:06 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:19:06.255453 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-a36426d1-7055-4e65-9fe1-235bfe4e05ac tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:19:06.256067 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-a36426d1-7055-4e65-9fe1-235bfe4e05ac tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 3e4bf9d8-4639-4c1d-92b9-112272598680] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:19:06.262649 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a36426d1-7055-4e65-9fe1-235bfe4e05ac tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:06.263087 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a36426d1-7055-4e65-9fe1-235bfe4e05ac tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:06.263839 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a36426d1-7055-4e65-9fe1-235bfe4e05ac tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:06.264272 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a36426d1-7055-4e65-9fe1-235bfe4e05ac tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:06.409974 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-a36426d1-7055-4e65-9fe1-235bfe4e05ac tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41741d00cf04063a21d163842ed5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247d4348634044b9840ae86b7022d72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:19:06.417435 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-a36426d1-7055-4e65-9fe1-235bfe4e05ac tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "GET /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680" status: 200 len: 1319 microversion: 2.1 time: 0.165584 Jul 05 16:19:06.418005 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 583/1022] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:19:06 2022] GET /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:19:07.244044 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-364d4f49-0b00-48d5-95ca-078f4921d56d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:19:07.244713 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-364d4f49-0b00-48d5-95ca-078f4921d56d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:19:07.251376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-364d4f49-0b00-48d5-95ca-078f4921d56d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:07.251828 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-364d4f49-0b00-48d5-95ca-078f4921d56d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:07.252719 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-364d4f49-0b00-48d5-95ca-078f4921d56d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:07.253274 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-364d4f49-0b00-48d5-95ca-078f4921d56d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:07.392070 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-364d4f49-0b00-48d5-95ca-078f4921d56d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:19:07.399768 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-364d4f49-0b00-48d5-95ca-078f4921d56d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1576 microversion: 2.1 time: 0.159749 Jul 05 16:19:07.400339 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 584/1023] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:19:07 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:19:07.433886 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-6e582dcd-096e-47a6-b505-907c42705aac tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:19:07.434522 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-6e582dcd-096e-47a6-b505-907c42705aac tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 3e4bf9d8-4639-4c1d-92b9-112272598680] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:19:07.440427 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6e582dcd-096e-47a6-b505-907c42705aac tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:07.440914 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6e582dcd-096e-47a6-b505-907c42705aac tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:07.441679 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6e582dcd-096e-47a6-b505-907c42705aac tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:07.442118 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6e582dcd-096e-47a6-b505-907c42705aac tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:07.569863 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-6e582dcd-096e-47a6-b505-907c42705aac tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41741d00cf04063a21d163842ed5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247d4348634044b9840ae86b7022d72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:19:07.577999 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-6e582dcd-096e-47a6-b505-907c42705aac tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "GET /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680" status: 200 len: 1319 microversion: 2.1 time: 0.148472 Jul 05 16:19:07.578574 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 585/1024] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:19:07 2022] GET /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:19:08.417283 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-8a4fca0c-a012-4efb-a35b-05067a660dcc tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:19:08.417884 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-8a4fca0c-a012-4efb-a35b-05067a660dcc tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:19:08.424241 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8a4fca0c-a012-4efb-a35b-05067a660dcc tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:08.424687 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8a4fca0c-a012-4efb-a35b-05067a660dcc tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:08.425480 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8a4fca0c-a012-4efb-a35b-05067a660dcc tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:08.425912 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8a4fca0c-a012-4efb-a35b-05067a660dcc tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:08.556441 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-8a4fca0c-a012-4efb-a35b-05067a660dcc tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:19:08.563890 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-8a4fca0c-a012-4efb-a35b-05067a660dcc tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1576 microversion: 2.1 time: 0.151111 Jul 05 16:19:08.564493 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 586/1025] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:19:08 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:19:08.594741 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-736cb698-5f3d-4073-b397-cd89e855b5f0 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:19:08.595353 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-736cb698-5f3d-4073-b397-cd89e855b5f0 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 3e4bf9d8-4639-4c1d-92b9-112272598680] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:19:08.601093 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-736cb698-5f3d-4073-b397-cd89e855b5f0 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:08.601547 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-736cb698-5f3d-4073-b397-cd89e855b5f0 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:08.602305 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-736cb698-5f3d-4073-b397-cd89e855b5f0 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:08.602743 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-736cb698-5f3d-4073-b397-cd89e855b5f0 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:08.617674 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell0:SELECT=2 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:08.735045 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-736cb698-5f3d-4073-b397-cd89e855b5f0 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41741d00cf04063a21d163842ed5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247d4348634044b9840ae86b7022d72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:19:08.742642 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-736cb698-5f3d-4073-b397-cd89e855b5f0 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "GET /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680" status: 200 len: 1319 microversion: 2.1 time: 0.151460 Jul 05 16:19:08.743204 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 587/1026] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:19:08 2022] GET /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:19:09.580791 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-3e21687f-8911-4b13-87b6-4dd24247064c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:19:09.581448 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-3e21687f-8911-4b13-87b6-4dd24247064c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:19:09.584284 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell0:SELECT=8 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:09.589011 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3e21687f-8911-4b13-87b6-4dd24247064c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:09.589456 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3e21687f-8911-4b13-87b6-4dd24247064c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:09.590228 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3e21687f-8911-4b13-87b6-4dd24247064c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:09.590667 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3e21687f-8911-4b13-87b6-4dd24247064c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:09.727657 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-3e21687f-8911-4b13-87b6-4dd24247064c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:19:09.735764 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-3e21687f-8911-4b13-87b6-4dd24247064c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1576 microversion: 2.1 time: 0.158469 Jul 05 16:19:09.736343 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 588/1027] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:19:09 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:19:09.741235 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-3dad907e-fd8f-4d56-9649-ef7adf4807e1 req-5af8ecba-6d0e-4a32-9283-145179c3d79d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e4bf9d8-4639-4c1d-92b9-112272598680", "name": "network-vif-plugged", "status": "completed", "tag": "6b1d876a-a238-4efc-bf3b-29b75958d783"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:19:09.750381 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-3dad907e-fd8f-4d56-9649-ef7adf4807e1 req-5af8ecba-6d0e-4a32-9283-145179c3d79d service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:09.750824 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-3dad907e-fd8f-4d56-9649-ef7adf4807e1 req-5af8ecba-6d0e-4a32-9283-145179c3d79d service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:09.770477 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-3dad907e-fd8f-4d56-9649-ef7adf4807e1 req-5af8ecba-6d0e-4a32-9283-145179c3d79d service nova] Creating event network-vif-plugged:6b1d876a-a238-4efc-bf3b-29b75958d783 for instance 3e4bf9d8-4639-4c1d-92b9-112272598680 on hv-cinder-84875 Jul 05 16:19:09.776200 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-3dad907e-fd8f-4d56-9649-ef7adf4807e1 req-5af8ecba-6d0e-4a32-9283-145179c3d79d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038726 Jul 05 16:19:09.776910 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 589/1028] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:19:09.781984 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-37fb3895-bcc1-452b-9093-d2c058cedf84 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:19:09.782688 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-37fb3895-bcc1-452b-9093-d2c058cedf84 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 3e4bf9d8-4639-4c1d-92b9-112272598680] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:19:09.789009 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-37fb3895-bcc1-452b-9093-d2c058cedf84 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:09.789465 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-37fb3895-bcc1-452b-9093-d2c058cedf84 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:09.790429 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-37fb3895-bcc1-452b-9093-d2c058cedf84 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:09.790684 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-37fb3895-bcc1-452b-9093-d2c058cedf84 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:09.923649 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-37fb3895-bcc1-452b-9093-d2c058cedf84 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41741d00cf04063a21d163842ed5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247d4348634044b9840ae86b7022d72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:19:09.931878 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-37fb3895-bcc1-452b-9093-d2c058cedf84 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "GET /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680" status: 200 len: 1319 microversion: 2.1 time: 0.153854 Jul 05 16:19:09.932607 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 590/1029] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:19:09 2022] GET /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:19:10.752563 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-3c690ca7-ff08-4feb-89fb-af7a4dd11c7b tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:19:10.753209 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-3c690ca7-ff08-4feb-89fb-af7a4dd11c7b tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:19:10.759854 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3c690ca7-ff08-4feb-89fb-af7a4dd11c7b tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:10.760296 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3c690ca7-ff08-4feb-89fb-af7a4dd11c7b tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:10.761078 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3c690ca7-ff08-4feb-89fb-af7a4dd11c7b tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:10.761514 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3c690ca7-ff08-4feb-89fb-af7a4dd11c7b tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:10.765634 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=100 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:10.894622 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-3c690ca7-ff08-4feb-89fb-af7a4dd11c7b tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:19:10.902560 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-3c690ca7-ff08-4feb-89fb-af7a4dd11c7b tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1576 microversion: 2.1 time: 0.154182 Jul 05 16:19:10.903518 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 591/1030] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:19:10 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:19:10.948591 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-dd1f62a9-22c2-4697-84e8-93ae0428b46f tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:19:10.949233 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-dd1f62a9-22c2-4697-84e8-93ae0428b46f tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 3e4bf9d8-4639-4c1d-92b9-112272598680] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:19:10.954991 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dd1f62a9-22c2-4697-84e8-93ae0428b46f tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:10.955428 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dd1f62a9-22c2-4697-84e8-93ae0428b46f tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:10.956183 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dd1f62a9-22c2-4697-84e8-93ae0428b46f tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:10.956682 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dd1f62a9-22c2-4697-84e8-93ae0428b46f tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:11.088181 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-dd1f62a9-22c2-4697-84e8-93ae0428b46f tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41741d00cf04063a21d163842ed5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247d4348634044b9840ae86b7022d72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:19:11.095612 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-dd1f62a9-22c2-4697-84e8-93ae0428b46f tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "GET /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680" status: 200 len: 1319 microversion: 2.1 time: 0.150725 Jul 05 16:19:11.096184 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 592/1031] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:19:10 2022] GET /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:19:11.790201 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-62ef2d0c-0f66-42d7-a5ec-32222be42ca2 req-99793d8e-7b64-40a4-acfc-1b91a0f7571a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e15bb7-d358-439f-b3bc-697f5c8ee180", "name": "network-vif-plugged", "status": "completed", "tag": "f472f8e8-76d0-4068-af84-5901b45f5f21"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:19:11.798598 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-62ef2d0c-0f66-42d7-a5ec-32222be42ca2 req-99793d8e-7b64-40a4-acfc-1b91a0f7571a service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:11.799044 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-62ef2d0c-0f66-42d7-a5ec-32222be42ca2 req-99793d8e-7b64-40a4-acfc-1b91a0f7571a service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:11.810559 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-62ef2d0c-0f66-42d7-a5ec-32222be42ca2 req-99793d8e-7b64-40a4-acfc-1b91a0f7571a service nova] Creating event network-vif-plugged:f472f8e8-76d0-4068-af84-5901b45f5f21 for instance c0e15bb7-d358-439f-b3bc-697f5c8ee180 on hv-cinder-84875 Jul 05 16:19:11.815359 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-62ef2d0c-0f66-42d7-a5ec-32222be42ca2 req-99793d8e-7b64-40a4-acfc-1b91a0f7571a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029314 Jul 05 16:19:11.815981 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 593/1032] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:19:11.920209 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-94126f87-bbac-433a-8cda-cc5e05b32070 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:19:11.920944 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-94126f87-bbac-433a-8cda-cc5e05b32070 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:19:11.927109 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-94126f87-bbac-433a-8cda-cc5e05b32070 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:11.927561 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-94126f87-bbac-433a-8cda-cc5e05b32070 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:11.928329 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-94126f87-bbac-433a-8cda-cc5e05b32070 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:11.928789 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-94126f87-bbac-433a-8cda-cc5e05b32070 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:12.063088 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-94126f87-bbac-433a-8cda-cc5e05b32070 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:19:12.071482 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-94126f87-bbac-433a-8cda-cc5e05b32070 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1576 microversion: 2.1 time: 0.155639 Jul 05 16:19:12.072063 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 594/1033] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:19:11 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:19:12.111640 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-19eef02d-7ae0-451c-b76c-83aab01306c9 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:19:12.112261 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-19eef02d-7ae0-451c-b76c-83aab01306c9 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 3e4bf9d8-4639-4c1d-92b9-112272598680] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:19:12.118801 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-19eef02d-7ae0-451c-b76c-83aab01306c9 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:12.119258 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-19eef02d-7ae0-451c-b76c-83aab01306c9 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:12.120028 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-19eef02d-7ae0-451c-b76c-83aab01306c9 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:12.120489 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-19eef02d-7ae0-451c-b76c-83aab01306c9 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:12.246446 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-19eef02d-7ae0-451c-b76c-83aab01306c9 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41741d00cf04063a21d163842ed5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247d4348634044b9840ae86b7022d72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:19:12.253905 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-19eef02d-7ae0-451c-b76c-83aab01306c9 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "GET /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680" status: 200 len: 1508 microversion: 2.1 time: 0.146408 Jul 05 16:19:12.254476 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 595/1034] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:19:12 2022] GET /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680 => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:19:12.270004 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-f53f9ea1-448a-4985-9946-509e454b4462 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10833ddf-3584-4f5a-ab4e-e38092dbaa99", "device": "/dev/sdb"}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:19:12.271084 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-f53f9ea1-448a-4985-9946-509e454b4462 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 3e4bf9d8-4639-4c1d-92b9-112272598680] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:19:12.277561 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f53f9ea1-448a-4985-9946-509e454b4462 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:12.278006 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f53f9ea1-448a-4985-9946-509e454b4462 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:12.278763 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f53f9ea1-448a-4985-9946-509e454b4462 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:12.279196 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f53f9ea1-448a-4985-9946-509e454b4462 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:12.941649 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-f53f9ea1-448a-4985-9946-509e454b4462 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "POST /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.675100 Jul 05 16:19:12.942492 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 596/1035] 10.222.0.45 () {60 vars in 1322 bytes} [Tue Jul 5 16:19:12 2022] POST /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680/os-volume_attachments => generated 194 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:19:13.089167 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-68463ed4-a108-45d3-bd05-71e8ce2c2888 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:19:13.089778 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-68463ed4-a108-45d3-bd05-71e8ce2c2888 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:19:13.096382 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-68463ed4-a108-45d3-bd05-71e8ce2c2888 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:13.096858 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-68463ed4-a108-45d3-bd05-71e8ce2c2888 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:13.097621 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-68463ed4-a108-45d3-bd05-71e8ce2c2888 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:13.098055 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-68463ed4-a108-45d3-bd05-71e8ce2c2888 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:13.231646 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-68463ed4-a108-45d3-bd05-71e8ce2c2888 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:19:13.239471 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-68463ed4-a108-45d3-bd05-71e8ce2c2888 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1576 microversion: 2.1 time: 0.155331 Jul 05 16:19:13.240120 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 597/1036] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:19:13 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:19:14.256123 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-75766d6c-b94c-4b38-92d1-21b99e9c2dbf tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:19:14.256667 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-75766d6c-b94c-4b38-92d1-21b99e9c2dbf tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:19:14.263783 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-75766d6c-b94c-4b38-92d1-21b99e9c2dbf tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:14.264224 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-75766d6c-b94c-4b38-92d1-21b99e9c2dbf tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:14.265019 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-75766d6c-b94c-4b38-92d1-21b99e9c2dbf tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:14.265453 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-75766d6c-b94c-4b38-92d1-21b99e9c2dbf tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:14.397629 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-75766d6c-b94c-4b38-92d1-21b99e9c2dbf tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:19:14.405622 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-75766d6c-b94c-4b38-92d1-21b99e9c2dbf tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1563 microversion: 2.1 time: 0.153422 Jul 05 16:19:14.406202 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 598/1037] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:19:14 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:19:32.897590 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-07e775ec-ee1a-43ab-9ea3-14e2ebad671e tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:19:32.898329 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-07e775ec-ee1a-43ab-9ea3-14e2ebad671e tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 3e4bf9d8-4639-4c1d-92b9-112272598680] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:19:32.900960 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_api:SELECT=40 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:32.901657 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:19:32.906369 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-07e775ec-ee1a-43ab-9ea3-14e2ebad671e tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:32.906823 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-07e775ec-ee1a-43ab-9ea3-14e2ebad671e tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:32.907582 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-07e775ec-ee1a-43ab-9ea3-14e2ebad671e tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:32.908016 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-07e775ec-ee1a-43ab-9ea3-14e2ebad671e tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:32.989873 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.objects.instance [None req-07e775ec-ee1a-43ab-9ea3-14e2ebad671e tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lazy-loading 'services' on Instance uuid 3e4bf9d8-4639-4c1d-92b9-112272598680 {{(pid=118320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 16:19:33.198783 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-07e775ec-ee1a-43ab-9ea3-14e2ebad671e tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680/os-volume_attachments/10833ddf-3584-4f5a-ab4e-e38092dbaa99" status: 202 len: 0 microversion: 2.1 time: 0.304987 Jul 05 16:19:33.199380 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 599/1038] 10.222.0.45 () {58 vars in 1415 bytes} [Tue Jul 5 16:19:32 2022] DELETE /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680/os-volume_attachments/10833ddf-3584-4f5a-ab4e-e38092dbaa99 => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 05 16:19:34.314549 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-3e237ee5-1321-40e6-b412-a7a645fea064 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:19:34.315144 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-3e237ee5-1321-40e6-b412-a7a645fea064 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 3e4bf9d8-4639-4c1d-92b9-112272598680] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:19:34.321936 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3e237ee5-1321-40e6-b412-a7a645fea064 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:34.322388 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3e237ee5-1321-40e6-b412-a7a645fea064 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:34.323145 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3e237ee5-1321-40e6-b412-a7a645fea064 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:34.323583 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-3e237ee5-1321-40e6-b412-a7a645fea064 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:34.347601 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-3e237ee5-1321-40e6-b412-a7a645fea064 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 3e4bf9d8-4639-4c1d-92b9-112272598680] Going to try to terminate instance {{(pid=118320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 16:19:34.684936 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-3e237ee5-1321-40e6-b412-a7a645fea064 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680" status: 204 len: 0 microversion: 2.1 time: 0.374852 Jul 05 16:19:34.685661 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 600/1039] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Jul 5 16:19:34 2022] DELETE /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 05 16:19:34.693944 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-bff6f6e0-b649-4648-848e-89b6605f9d7f tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:19:34.696190 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-bff6f6e0-b649-4648-848e-89b6605f9d7f tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 3e4bf9d8-4639-4c1d-92b9-112272598680] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:19:34.700646 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bff6f6e0-b649-4648-848e-89b6605f9d7f tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:34.701128 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bff6f6e0-b649-4648-848e-89b6605f9d7f tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:34.701901 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bff6f6e0-b649-4648-848e-89b6605f9d7f tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:34.702342 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bff6f6e0-b649-4648-848e-89b6605f9d7f tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:34.833015 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-bff6f6e0-b649-4648-848e-89b6605f9d7f tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41741d00cf04063a21d163842ed5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247d4348634044b9840ae86b7022d72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:19:34.840873 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-bff6f6e0-b649-4648-848e-89b6605f9d7f tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "GET /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680" status: 200 len: 1514 microversion: 2.1 time: 0.150871 Jul 05 16:19:34.841437 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 601/1040] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:19:34 2022] GET /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:19:35.858359 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-8d37e85f-0f30-40d9-a9eb-263aa07bd0fc tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:19:35.859015 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-8d37e85f-0f30-40d9-a9eb-263aa07bd0fc tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 3e4bf9d8-4639-4c1d-92b9-112272598680] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:19:35.865714 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8d37e85f-0f30-40d9-a9eb-263aa07bd0fc tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:35.866164 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8d37e85f-0f30-40d9-a9eb-263aa07bd0fc tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:35.866924 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8d37e85f-0f30-40d9-a9eb-263aa07bd0fc tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:35.867362 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8d37e85f-0f30-40d9-a9eb-263aa07bd0fc tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:35.992303 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-8d37e85f-0f30-40d9-a9eb-263aa07bd0fc tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41741d00cf04063a21d163842ed5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247d4348634044b9840ae86b7022d72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:19:36.000340 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-8d37e85f-0f30-40d9-a9eb-263aa07bd0fc tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "GET /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680" status: 200 len: 1514 microversion: 2.1 time: 0.145858 Jul 05 16:19:36.000937 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 602/1041] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:19:35 2022] GET /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680 => generated 1514 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:19:36.918946 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-97c2cd8d-e87b-402f-b4c1-d6642fd8e91a req-5cdf252d-feb0-4c15-b9fd-df4af5c30330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e4bf9d8-4639-4c1d-92b9-112272598680", "name": "network-vif-deleted", "tag": "6b1d876a-a238-4efc-bf3b-29b75958d783"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:19:36.931481 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-97c2cd8d-e87b-402f-b4c1-d6642fd8e91a req-5cdf252d-feb0-4c15-b9fd-df4af5c30330 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:36.932389 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-97c2cd8d-e87b-402f-b4c1-d6642fd8e91a req-5cdf252d-feb0-4c15-b9fd-df4af5c30330 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:36.951691 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-97c2cd8d-e87b-402f-b4c1-d6642fd8e91a req-5cdf252d-feb0-4c15-b9fd-df4af5c30330 service nova] Creating event network-vif-deleted:6b1d876a-a238-4efc-bf3b-29b75958d783 for instance 3e4bf9d8-4639-4c1d-92b9-112272598680 on hv-cinder-84875 Jul 05 16:19:36.956973 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-97c2cd8d-e87b-402f-b4c1-d6642fd8e91a req-5cdf252d-feb0-4c15-b9fd-df4af5c30330 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106285 Jul 05 16:19:36.957586 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 603/1042] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:19:37.017833 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-d55ab2da-8b93-4ee8-8079-2178a603a70b tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:19:37.018495 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-d55ab2da-8b93-4ee8-8079-2178a603a70b tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 3e4bf9d8-4639-4c1d-92b9-112272598680] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:19:37.025094 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d55ab2da-8b93-4ee8-8079-2178a603a70b tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:37.025546 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d55ab2da-8b93-4ee8-8079-2178a603a70b tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:37.026338 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d55ab2da-8b93-4ee8-8079-2178a603a70b tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:37.026794 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d55ab2da-8b93-4ee8-8079-2178a603a70b tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:37.089264 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-d55ab2da-8b93-4ee8-8079-2178a603a70b tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41741d00cf04063a21d163842ed5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247d4348634044b9840ae86b7022d72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:19:37.096702 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-d55ab2da-8b93-4ee8-8079-2178a603a70b tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "GET /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680" status: 200 len: 1304 microversion: 2.1 time: 0.083147 Jul 05 16:19:37.098221 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 604/1043] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:19:37 2022] GET /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680 => generated 1304 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:19:38.113435 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-5c67c1c4-e3ca-4a95-aaae-ef76af998950 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:19:38.114052 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-5c67c1c4-e3ca-4a95-aaae-ef76af998950 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] [instance: 3e4bf9d8-4639-4c1d-92b9-112272598680] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:19:38.120381 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5c67c1c4-e3ca-4a95-aaae-ef76af998950 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:38.120856 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5c67c1c4-e3ca-4a95-aaae-ef76af998950 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:38.121612 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5c67c1c4-e3ca-4a95-aaae-ef76af998950 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:19:38.122048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5c67c1c4-e3ca-4a95-aaae-ef76af998950 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:19:38.138095 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-5c67c1c4-e3ca-4a95-aaae-ef76af998950 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] HTTP exception thrown: Instance 3e4bf9d8-4639-4c1d-92b9-112272598680 could not be found. Jul 05 16:19:38.139711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-5c67c1c4-e3ca-4a95-aaae-ef76af998950 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Request method failure captured: Jul 05 16:19:38.139711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: GET /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680 HTTP/1.1 Jul 05 16:19:38.139711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:19:38.139711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:19:38.139711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:19:38.139711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:19:38.139711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:19:38.139711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:19:38.139711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:19:38.139711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:19:38.139711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGQtK55GZgkvTnkGPOny1JSAx91Tc0DXBpQIFwSuhRjrKAFsBoYNnD0mTw9w58P8nTlF66WQUCoi-xout772XAGUK_wr4Whsxo6pDblhMg6-Dum4Z1G4tbyls4biDFn4MPHmG2myoamwX_dO79o3wgWMpW0OodM9bRY-xwz7iqToOKs Jul 05 16:19:38.139711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:19:38.139711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:19:38.139711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:19:38.139711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:19:38.139711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:19:38.139711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:19:38.139711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 247d4348634044b9840ae86b7022d72c Jul 05 16:19:38.139711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1396655489 Jul 05 16:19:38.139711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:19:38.139711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:19:38.141494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_247d4348634044b9840ae86b7022d72c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/247d4348634044b9840ae86b7022d72c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/247d4348634044b9840ae86b7022d72c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/247d4348634044b9840ae86b7022d72c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:19:38.141494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-VolumesSnapshotTestJSON-1396655489 Jul 05 16:19:38.141494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 247d4348634044b9840ae86b7022d72c Jul 05 16:19:38.141494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1396655489 Jul 05 16:19:38.141494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-VolumesSnapshotTestJSON-1396655489-project Jul 05 16:19:38.141494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:19:38.141494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:19:38.141494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: e41741d00cf04063a21d163842ed5abe Jul 05 16:19:38.141494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-VolumesSnapshotTestJSON-1396655489-project Jul 05 16:19:38.141494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:19:38.141494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance 3e4bf9d8-4639-4c1d-92b9-112272598680 could not be found. Jul 05 16:19:38.141494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': '3e4bf9d8-4639-4c1d-92b9-112272598680'} Jul 05 16:19:38.142346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:19:38.142346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:19:38.142346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:19:38.142346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:19:38.142346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:19:38.142346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:19:38.142346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:19:38.142346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:19:38.142346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:19:38.142346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:19:38.142346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e4bf9d8-4639-4c1d-92b9-112272598680 could not be found. Jul 05 16:19:38.142346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:19:38.142346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:19:38.142346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:19:38.142346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:19:38.142346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:19:38.142346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:19:38.142346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:19:38.142346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:19:38.142346 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:19:38.143963 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:19:38.143963 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 16:19:38.143963 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 16:19:38.143963 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:19:38.143963 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:19:38.143963 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:19:38.143963 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:19:38.143963 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e4bf9d8-4639-4c1d-92b9-112272598680 could not be found. Jul 05 16:19:38.143963 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:19:38.143963 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:19:38.143963 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:19:38.143963 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:19:38.143963 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:19:38.143963 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:19:38.143963 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:19:38.143963 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:19:38.143963 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e4bf9d8-4639-4c1d-92b9-112272598680 could not be found. Jul 05 16:19:38.143963 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:19:38.145398 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-5c67c1c4-e3ca-4a95-aaae-ef76af998950 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] Returning 404 to user: Instance 3e4bf9d8-4639-4c1d-92b9-112272598680 could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:19:38.145398 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-5c67c1c4-e3ca-4a95-aaae-ef76af998950 tempest-VolumesSnapshotTestJSON-1396655489 tempest-VolumesSnapshotTestJSON-1396655489-project] 10.222.0.45 "GET /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680" status: 404 len: 111 microversion: 2.1 time: 0.031804 Jul 05 16:19:38.145398 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 605/1044] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:19:38 2022] GET /compute/v2.1/servers/3e4bf9d8-4639-4c1d-92b9-112272598680 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 16:20:15.504852 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:20:15.506220 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:20:15.669583 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-f9b1d385-6422-4d01-b902-12991188fcdb tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Action: 'create', calling method: .version_select at 0x7f3087f36820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1168178998", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEX/BLFw8G2WIeIt57LVHC5AdITrLBX/wQ5JkP0xuue6LLNcNXMWjQqnkL7c0iWuWAQ+ypboekMeqVz6HQjnFoMXwXo4QhI6Dm+SNTWMsn297zbcIk2uF3NbsQ2vJMDE/Q=="}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:20:15.683895 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-f9b1d385-6422-4d01-b902-12991188fcdb tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Getting quotas for project 85bf8c1d40a04aaf9e46cd7f1e58048a. Resources: {'key_pairs'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:20:15.687888 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-f9b1d385-6422-4d01-b902-12991188fcdb tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Getting quotas for user b1cf6897a2a74b7c84b26bae868845f4 and project 85bf8c1d40a04aaf9e46cd7f1e58048a. Resources: {'key_pairs'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:20:15.799810 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-f9b1d385-6422-4d01-b902-12991188fcdb tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.300208 Jul 05 16:20:15.800419 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 606/1045] 10.222.0.45 () {60 vars in 1158 bytes} [Tue Jul 5 16:20:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:20:32.766474 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell0:SELECT=4 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:20:32.767302 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:20:32.771289 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-68b99d52-6897-496c-bac2-cde483ffe747 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:20:32.771863 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-68b99d52-6897-496c-bac2-cde483ffe747 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:20:32.778283 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-68b99d52-6897-496c-bac2-cde483ffe747 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:32.783173 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-68b99d52-6897-496c-bac2-cde483ffe747 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:32.783173 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-68b99d52-6897-496c-bac2-cde483ffe747 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:32.783173 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-68b99d52-6897-496c-bac2-cde483ffe747 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:32.805448 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-68b99d52-6897-496c-bac2-cde483ffe747 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Going to try to terminate instance {{(pid=118320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 16:20:33.129540 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-68b99d52-6897-496c-bac2-cde483ffe747 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 204 len: 0 microversion: 2.1 time: 0.364206 Jul 05 16:20:33.130145 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 607/1046] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Jul 5 16:20:32 2022] DELETE /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 05 16:20:33.191284 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-1a2df21c-07af-44df-a747-ccf7cbaf6c79 req-e2804f06-0ace-47d4-8613-968cfbdeef6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0e15bb7-d358-439f-b3bc-697f5c8ee180", "tag": "f472f8e8-76d0-4068-af84-5901b45f5f21"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:20:33.199783 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-1a2df21c-07af-44df-a747-ccf7cbaf6c79 req-e2804f06-0ace-47d4-8613-968cfbdeef6a service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:33.200229 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-1a2df21c-07af-44df-a747-ccf7cbaf6c79 req-e2804f06-0ace-47d4-8613-968cfbdeef6a service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:33.211285 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-1a2df21c-07af-44df-a747-ccf7cbaf6c79 req-e2804f06-0ace-47d4-8613-968cfbdeef6a service nova] Creating event network-changed:f472f8e8-76d0-4068-af84-5901b45f5f21 for instance c0e15bb7-d358-439f-b3bc-697f5c8ee180 on hv-cinder-84875 Jul 05 16:20:33.216785 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-1a2df21c-07af-44df-a747-ccf7cbaf6c79 req-e2804f06-0ace-47d4-8613-968cfbdeef6a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085258 Jul 05 16:20:33.217701 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 608/1047] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:20:33.222563 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-9159519f-6112-46ee-b9d3-568e3418e9b7 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:20:33.223254 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-9159519f-6112-46ee-b9d3-568e3418e9b7 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:20:33.229415 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9159519f-6112-46ee-b9d3-568e3418e9b7 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:33.229866 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9159519f-6112-46ee-b9d3-568e3418e9b7 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:33.230633 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9159519f-6112-46ee-b9d3-568e3418e9b7 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:33.231066 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9159519f-6112-46ee-b9d3-568e3418e9b7 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:33.369448 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-9159519f-6112-46ee-b9d3-568e3418e9b7 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:20:33.377048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-9159519f-6112-46ee-b9d3-568e3418e9b7 tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1569 microversion: 2.1 time: 0.158206 Jul 05 16:20:33.377622 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 609/1048] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:20:33 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:20:33.746014 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-64e8219a-db6f-48dd-ace1-e38fb3936181 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-924209126", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1168178998", "security_groups": [{"name": "tempest-secgroup-smoke-1594892166"}], "block_device_mapping_v2": [{"uuid": "5701c46e-3bcb-4646-aa8c-b744f31a98f4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9e6fae8e-72c3-49ba-ab85-7183288aac1f"}]}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:20:33.858762 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.network.neutron [None req-64e8219a-db6f-48dd-ace1-e38fb3936181 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] validate_networks() for [('9e6fae8e-72c3-49ba-ab85-7183288aac1f', None, None, None, None, None)] {{(pid=118320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 16:20:34.354250 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-64e8219a-db6f-48dd-ace1-e38fb3936181 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Flavor limits 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 16:20:34.354687 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-64e8219a-db6f-48dd-ace1-e38fb3936181 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Image limits 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 16:20:34.355159 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-64e8219a-db6f-48dd-ace1-e38fb3936181 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Flavor pref 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 16:20:34.355568 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-64e8219a-db6f-48dd-ace1-e38fb3936181 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Image pref 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 16:20:34.355977 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-64e8219a-db6f-48dd-ace1-e38fb3936181 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 16:20:34.365414 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-64e8219a-db6f-48dd-ace1-e38fb3936181 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:34.365953 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-64e8219a-db6f-48dd-ace1-e38fb3936181 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:34.366755 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-64e8219a-db6f-48dd-ace1-e38fb3936181 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:34.367196 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-64e8219a-db6f-48dd-ace1-e38fb3936181 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:34.384923 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-64e8219a-db6f-48dd-ace1-e38fb3936181 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Getting quotas for project 85bf8c1d40a04aaf9e46cd7f1e58048a. Resources: {'ram', 'instances', 'cores'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:20:34.388870 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-64e8219a-db6f-48dd-ace1-e38fb3936181 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Getting quotas for user b1cf6897a2a74b7c84b26bae868845f4 and project 85bf8c1d40a04aaf9e46cd7f1e58048a. Resources: {'ram', 'instances', 'cores'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:20:34.444870 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-64e8219a-db6f-48dd-ace1-e38fb3936181 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Going to run 1 instances... {{(pid=118320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 16:20:34.447552 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-64e8219a-db6f-48dd-ace1-e38fb3936181 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5701c46e-3bcb-4646-aa8c-b744f31a98f4',volume_size=None,volume_type=None)] {{(pid=118320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 16:20:34.834520 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-64e8219a-db6f-48dd-ace1-e38fb3936181 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.092896 Jul 05 16:20:34.840119 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 610/1049] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Jul 5 16:20:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 05 16:20:34.844799 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-219d3017-36de-4d0a-b284-1bb0bf47585b tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:20:34.845435 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-219d3017-36de-4d0a-b284-1bb0bf47585b tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:20:34.851666 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-219d3017-36de-4d0a-b284-1bb0bf47585b tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:34.864749 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-219d3017-36de-4d0a-b284-1bb0bf47585b tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:34.865810 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-219d3017-36de-4d0a-b284-1bb0bf47585b tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:34.866265 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-219d3017-36de-4d0a-b284-1bb0bf47585b tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:35.451832 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-219d3017-36de-4d0a-b284-1bb0bf47585b tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:20:35.460797 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-219d3017-36de-4d0a-b284-1bb0bf47585b tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1569 microversion: 2.1 time: 0.619707 Jul 05 16:20:35.461384 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 611/1050] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:20:34 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1569 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:20:35.467174 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-33cef378-6f8a-4bea-a00b-cda993950dfa tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:20:35.467998 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-33cef378-6f8a-4bea-a00b-cda993950dfa tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:20:35.529140 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-33cef378-6f8a-4bea-a00b-cda993950dfa tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:20:35.535775 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-33cef378-6f8a-4bea-a00b-cda993950dfa tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8" status: 200 len: 1094 microversion: 2.1 time: 0.073423 Jul 05 16:20:35.536341 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 612/1051] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:20:35 2022] GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:20:35.731951 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-f7fed186-b49e-46c2-bcfc-0eafa183bf63 req-0194158e-0065-4724-85da-3e27bbf0bc73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e15bb7-d358-439f-b3bc-697f5c8ee180", "name": "network-vif-deleted", "tag": "f472f8e8-76d0-4068-af84-5901b45f5f21"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:20:35.740834 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-f7fed186-b49e-46c2-bcfc-0eafa183bf63 req-0194158e-0065-4724-85da-3e27bbf0bc73 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:35.741282 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-f7fed186-b49e-46c2-bcfc-0eafa183bf63 req-0194158e-0065-4724-85da-3e27bbf0bc73 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:35.751879 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-f7fed186-b49e-46c2-bcfc-0eafa183bf63 req-0194158e-0065-4724-85da-3e27bbf0bc73 service nova] Creating event network-vif-deleted:f472f8e8-76d0-4068-af84-5901b45f5f21 for instance c0e15bb7-d358-439f-b3bc-697f5c8ee180 on hv-cinder-84875 Jul 05 16:20:35.756699 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-f7fed186-b49e-46c2-bcfc-0eafa183bf63 req-0194158e-0065-4724-85da-3e27bbf0bc73 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028472 Jul 05 16:20:35.757330 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 613/1052] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:20:36.480202 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-a94d1906-fc63-4084-9ee1-0a8f8ba6860c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:20:36.480977 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-a94d1906-fc63-4084-9ee1-0a8f8ba6860c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:20:36.487799 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a94d1906-fc63-4084-9ee1-0a8f8ba6860c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:36.490973 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a94d1906-fc63-4084-9ee1-0a8f8ba6860c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:36.490973 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a94d1906-fc63-4084-9ee1-0a8f8ba6860c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:36.490973 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a94d1906-fc63-4084-9ee1-0a8f8ba6860c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:36.523515 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a94d1906-fc63-4084-9ee1-0a8f8ba6860c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:36.523966 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-a94d1906-fc63-4084-9ee1-0a8f8ba6860c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:36.524415 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.objects.instance [None req-a94d1906-fc63-4084-9ee1-0a8f8ba6860c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lazy-loading 'fault' on Instance uuid c0e15bb7-d358-439f-b3bc-697f5c8ee180 {{(pid=118320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 16:20:36.568223 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-a94d1906-fc63-4084-9ee1-0a8f8ba6860c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5390b9df9b445380119b995f4c457d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de07093c553b4f0391c85e5ea04cf7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:20:36.575778 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-a94d1906-fc63-4084-9ee1-0a8f8ba6860c tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 200 len: 1225 microversion: 2.1 time: 0.100958 Jul 05 16:20:36.576341 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 614/1053] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:20:36 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:20:36.580689 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-14f90c41-9b47-40d3-9c9e-04ba88432676 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:20:36.581327 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-14f90c41-9b47-40d3-9c9e-04ba88432676 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:20:36.586868 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-14f90c41-9b47-40d3-9c9e-04ba88432676 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:36.587841 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-14f90c41-9b47-40d3-9c9e-04ba88432676 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:36.588598 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-14f90c41-9b47-40d3-9c9e-04ba88432676 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:36.589101 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-14f90c41-9b47-40d3-9c9e-04ba88432676 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:36.652477 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-14f90c41-9b47-40d3-9c9e-04ba88432676 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:20:36.659973 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-14f90c41-9b47-40d3-9c9e-04ba88432676 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8" status: 200 len: 1192 microversion: 2.1 time: 0.082651 Jul 05 16:20:36.663201 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 615/1054] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:20:36 2022] GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 => generated 1192 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:20:37.592759 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-6c22d9ac-0838-4a9c-b719-db744fadae4d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:20:37.593412 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-6c22d9ac-0838-4a9c-b719-db744fadae4d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] [instance: c0e15bb7-d358-439f-b3bc-697f5c8ee180] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:20:37.599775 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6c22d9ac-0838-4a9c-b719-db744fadae4d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:37.600232 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6c22d9ac-0838-4a9c-b719-db744fadae4d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:37.601036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6c22d9ac-0838-4a9c-b719-db744fadae4d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:37.601463 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6c22d9ac-0838-4a9c-b719-db744fadae4d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:37.615984 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-6c22d9ac-0838-4a9c-b719-db744fadae4d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] HTTP exception thrown: Instance c0e15bb7-d358-439f-b3bc-697f5c8ee180 could not be found. Jul 05 16:20:37.617754 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-6c22d9ac-0838-4a9c-b719-db744fadae4d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Request method failure captured: Jul 05 16:20:37.617754 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 HTTP/1.1 Jul 05 16:20:37.617754 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:20:37.617754 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:20:37.617754 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:20:37.617754 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:20:37.617754 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:20:37.617754 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:20:37.617754 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:20:37.617754 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:20:37.617754 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGO7gkXN0e5dvvFEl4ew_PVnvsLGs5lQvHeZHPO8ir1P_Pz_BqUUfpUF4JRUzhsasYpk42fhZzd857Z_t4pY8an5JU2Z6b4NASPvNu86A7MlHCYpizeC_zK-GHrzNkw8pQhexlJJEpnBUO_uCZZvJEb-PlmQl89CvXgcF7HEvrPe_6s Jul 05 16:20:37.617754 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:20:37.617754 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:20:37.617754 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:20:37.617754 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:20:37.617754 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:20:37.617754 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:20:37.617754 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: de07093c553b4f0391c85e5ea04cf7f1 Jul 05 16:20:37.617754 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-TestShelveInstance-1463777914 Jul 05 16:20:37.617754 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:20:37.617754 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:20:37.620048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_de07093c553b4f0391c85e5ea04cf7f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/de07093c553b4f0391c85e5ea04cf7f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/de07093c553b4f0391c85e5ea04cf7f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/de07093c553b4f0391c85e5ea04cf7f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:20:37.620048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-TestShelveInstance-1463777914 Jul 05 16:20:37.620048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: de07093c553b4f0391c85e5ea04cf7f1 Jul 05 16:20:37.620048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-TestShelveInstance-1463777914 Jul 05 16:20:37.620048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-TestShelveInstance-1463777914-project Jul 05 16:20:37.620048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:20:37.620048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:20:37.620048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: fe5390b9df9b445380119b995f4c457d Jul 05 16:20:37.620048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-TestShelveInstance-1463777914-project Jul 05 16:20:37.620048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:20:37.620048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance c0e15bb7-d358-439f-b3bc-697f5c8ee180 could not be found. Jul 05 16:20:37.620048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': 'c0e15bb7-d358-439f-b3bc-697f5c8ee180'} Jul 05 16:20:37.620998 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:20:37.620998 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:20:37.620998 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:20:37.620998 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:20:37.620998 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:20:37.620998 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:20:37.620998 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:20:37.620998 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:20:37.620998 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:20:37.620998 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:20:37.620998 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0e15bb7-d358-439f-b3bc-697f5c8ee180 could not be found. Jul 05 16:20:37.620998 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:20:37.620998 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:20:37.620998 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:20:37.620998 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:20:37.620998 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:20:37.620998 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:20:37.620998 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:20:37.620998 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:20:37.620998 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:20:37.622371 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:20:37.622371 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 16:20:37.622371 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 16:20:37.622371 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:20:37.622371 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:20:37.622371 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:20:37.622371 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:20:37.622371 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0e15bb7-d358-439f-b3bc-697f5c8ee180 could not be found. Jul 05 16:20:37.622371 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:20:37.622371 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:20:37.622371 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:20:37.622371 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:20:37.622371 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:20:37.622371 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:20:37.622371 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:20:37.622371 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:20:37.622371 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0e15bb7-d358-439f-b3bc-697f5c8ee180 could not be found. Jul 05 16:20:37.622371 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:20:37.623600 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-6c22d9ac-0838-4a9c-b719-db744fadae4d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Returning 404 to user: Instance c0e15bb7-d358-439f-b3bc-697f5c8ee180 could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:20:37.623600 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-6c22d9ac-0838-4a9c-b719-db744fadae4d tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180" status: 404 len: 111 microversion: 2.1 time: 0.030868 Jul 05 16:20:37.623600 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 616/1055] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:20:37 2022] GET /compute/v2.1/servers/c0e15bb7-d358-439f-b3bc-697f5c8ee180 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 16:20:37.677655 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-5fe477e6-c835-4b92-b8e8-ce5a8b24b496 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:20:37.678724 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-5fe477e6-c835-4b92-b8e8-ce5a8b24b496 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:20:37.685939 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5fe477e6-c835-4b92-b8e8-ce5a8b24b496 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:37.686398 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5fe477e6-c835-4b92-b8e8-ce5a8b24b496 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:37.687371 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5fe477e6-c835-4b92-b8e8-ce5a8b24b496 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:37.687852 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5fe477e6-c835-4b92-b8e8-ce5a8b24b496 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:37.779845 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-5fe477e6-c835-4b92-b8e8-ce5a8b24b496 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:20:37.787716 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-5fe477e6-c835-4b92-b8e8-ce5a8b24b496 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8" status: 200 len: 1210 microversion: 2.1 time: 0.114027 Jul 05 16:20:37.788301 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 617/1056] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:20:37 2022] GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 => generated 1210 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:20:38.126714 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-c5ec9067-d763-4f54-b5ad-fb039d53efef tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] Calling method '.version_select at 0x7f3087c2f0d0>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:20:38.234085 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-c5ec9067-d763-4f54-b5ad-fb039d53efef tempest-TestShelveInstance-1463777914 tempest-TestShelveInstance-1463777914-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2031343749" status: 202 len: 0 microversion: 2.1 time: 0.111419 Jul 05 16:20:38.235191 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 618/1057] 10.222.0.45 () {58 vars in 1253 bytes} [Tue Jul 5 16:20:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2031343749 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 16:20:38.808630 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-f3e897ef-d3f2-4552-b087-13a40384edf5 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:20:38.809387 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-f3e897ef-d3f2-4552-b087-13a40384edf5 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:20:38.816438 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f3e897ef-d3f2-4552-b087-13a40384edf5 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:38.817324 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f3e897ef-d3f2-4552-b087-13a40384edf5 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:38.818110 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f3e897ef-d3f2-4552-b087-13a40384edf5 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:38.820419 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f3e897ef-d3f2-4552-b087-13a40384edf5 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:38.979355 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-f3e897ef-d3f2-4552-b087-13a40384edf5 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:20:38.987224 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-f3e897ef-d3f2-4552-b087-13a40384edf5 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8" status: 200 len: 1266 microversion: 2.1 time: 0.183396 Jul 05 16:20:38.987802 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 619/1058] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:20:38 2022] GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:20:39.050352 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-abe6a8ca-c475-4866-845d-3cc947596099 req-90658307-2955-48ce-950b-182f39aa3a89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8", "tag": "a26b2bfa-904b-45ed-bb37-bf3fd116ea36"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:20:39.066924 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-abe6a8ca-c475-4866-845d-3cc947596099 req-90658307-2955-48ce-950b-182f39aa3a89 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:39.067676 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-abe6a8ca-c475-4866-845d-3cc947596099 req-90658307-2955-48ce-950b-182f39aa3a89 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:39.081123 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-abe6a8ca-c475-4866-845d-3cc947596099 req-90658307-2955-48ce-950b-182f39aa3a89 service nova] Creating event network-changed:a26b2bfa-904b-45ed-bb37-bf3fd116ea36 for instance f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 on hv-cinder-84875 Jul 05 16:20:39.086377 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-abe6a8ca-c475-4866-845d-3cc947596099 req-90658307-2955-48ce-950b-182f39aa3a89 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040428 Jul 05 16:20:39.087467 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 620/1059] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:20:40.010336 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-b4d464b1-922e-478b-b853-b26732e772e8 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:20:40.010970 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-b4d464b1-922e-478b-b853-b26732e772e8 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:20:40.017653 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b4d464b1-922e-478b-b853-b26732e772e8 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:40.018108 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b4d464b1-922e-478b-b853-b26732e772e8 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:40.031372 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b4d464b1-922e-478b-b853-b26732e772e8 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:40.031372 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b4d464b1-922e-478b-b853-b26732e772e8 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:40.167099 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-b4d464b1-922e-478b-b853-b26732e772e8 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:20:40.175314 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-b4d464b1-922e-478b-b853-b26732e772e8 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8" status: 200 len: 1266 microversion: 2.1 time: 0.169859 Jul 05 16:20:40.176004 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 621/1060] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:20:40 2022] GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:20:41.192743 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-6814a42c-1792-4b5e-b4b5-16c014c2751e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:20:41.193939 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-6814a42c-1792-4b5e-b4b5-16c014c2751e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:20:41.204410 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6814a42c-1792-4b5e-b4b5-16c014c2751e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:41.204935 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6814a42c-1792-4b5e-b4b5-16c014c2751e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:41.205845 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6814a42c-1792-4b5e-b4b5-16c014c2751e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:41.206287 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6814a42c-1792-4b5e-b4b5-16c014c2751e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:41.423801 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-6814a42c-1792-4b5e-b4b5-16c014c2751e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:20:41.431106 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-6814a42c-1792-4b5e-b4b5-16c014c2751e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8" status: 200 len: 1266 microversion: 2.1 time: 0.242574 Jul 05 16:20:41.431678 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 622/1061] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:20:41 2022] GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:20:41.995928 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 16:20:41.996505 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Tue Jul 5 16:20:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 (ip 10.222.0.45) !!! Jul 05 16:20:42.447949 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-290e1df0-a104-4f57-9a45-ee4e9762e0f4 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:20:42.448577 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-290e1df0-a104-4f57-9a45-ee4e9762e0f4 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:20:42.455045 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-290e1df0-a104-4f57-9a45-ee4e9762e0f4 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:42.455527 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-290e1df0-a104-4f57-9a45-ee4e9762e0f4 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:42.456303 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-290e1df0-a104-4f57-9a45-ee4e9762e0f4 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:42.456747 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-290e1df0-a104-4f57-9a45-ee4e9762e0f4 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:42.587984 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-290e1df0-a104-4f57-9a45-ee4e9762e0f4 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:20:42.595615 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-290e1df0-a104-4f57-9a45-ee4e9762e0f4 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8" status: 200 len: 1266 microversion: 2.1 time: 0.151774 Jul 05 16:20:42.596189 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 623/1062] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:20:42 2022] GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:20:43.613368 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-b3f006ea-002d-4d8a-a680-06b33d9dba01 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:20:43.614337 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-b3f006ea-002d-4d8a-a680-06b33d9dba01 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:20:43.621544 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b3f006ea-002d-4d8a-a680-06b33d9dba01 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:43.625899 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b3f006ea-002d-4d8a-a680-06b33d9dba01 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:43.625899 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b3f006ea-002d-4d8a-a680-06b33d9dba01 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:43.625899 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-b3f006ea-002d-4d8a-a680-06b33d9dba01 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:43.764870 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-b3f006ea-002d-4d8a-a680-06b33d9dba01 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:20:43.780031 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-b3f006ea-002d-4d8a-a680-06b33d9dba01 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8" status: 200 len: 1266 microversion: 2.1 time: 0.164007 Jul 05 16:20:43.780031 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 624/1063] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:20:43 2022] GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:20:44.791054 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-5f6faac4-bf5b-4184-aa36-1e03cebc690c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:20:44.792357 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-5f6faac4-bf5b-4184-aa36-1e03cebc690c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:20:44.794610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell0:SELECT=2 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:20:44.800212 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5f6faac4-bf5b-4184-aa36-1e03cebc690c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:44.800734 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5f6faac4-bf5b-4184-aa36-1e03cebc690c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:44.801596 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5f6faac4-bf5b-4184-aa36-1e03cebc690c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:44.802092 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5f6faac4-bf5b-4184-aa36-1e03cebc690c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:45.031027 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-5f6faac4-bf5b-4184-aa36-1e03cebc690c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:20:45.038683 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-5f6faac4-bf5b-4184-aa36-1e03cebc690c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8" status: 200 len: 1266 microversion: 2.1 time: 0.252544 Jul 05 16:20:45.039351 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 625/1064] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:20:44 2022] GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:20:46.055512 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-98aded9a-61a5-4e48-8451-3f58d64fa235 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:20:46.056121 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-98aded9a-61a5-4e48-8451-3f58d64fa235 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:20:46.058008 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell0:SELECT=8 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:20:46.063449 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-98aded9a-61a5-4e48-8451-3f58d64fa235 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:46.063905 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-98aded9a-61a5-4e48-8451-3f58d64fa235 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:46.064837 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-98aded9a-61a5-4e48-8451-3f58d64fa235 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:46.065252 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-98aded9a-61a5-4e48-8451-3f58d64fa235 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:46.211121 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-98aded9a-61a5-4e48-8451-3f58d64fa235 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:20:46.214959 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:20:46.219571 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-98aded9a-61a5-4e48-8451-3f58d64fa235 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8" status: 200 len: 1266 microversion: 2.1 time: 0.168120 Jul 05 16:20:46.220355 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 626/1065] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:20:46 2022] GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:20:47.237351 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-624c2081-c869-4199-a2bd-cf0bade00b88 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:20:47.238022 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-624c2081-c869-4199-a2bd-cf0bade00b88 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:20:47.245319 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-624c2081-c869-4199-a2bd-cf0bade00b88 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:47.245776 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-624c2081-c869-4199-a2bd-cf0bade00b88 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:47.246813 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-624c2081-c869-4199-a2bd-cf0bade00b88 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:47.247078 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-624c2081-c869-4199-a2bd-cf0bade00b88 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:47.394673 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-624c2081-c869-4199-a2bd-cf0bade00b88 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:20:47.403359 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-624c2081-c869-4199-a2bd-cf0bade00b88 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8" status: 200 len: 1266 microversion: 2.1 time: 0.170258 Jul 05 16:20:47.403952 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 627/1066] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:20:47 2022] GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:20:48.420300 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-401055d0-0bbe-44f7-bf98-02606d877838 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:20:48.421085 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-401055d0-0bbe-44f7-bf98-02606d877838 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:20:48.427615 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-401055d0-0bbe-44f7-bf98-02606d877838 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:48.428070 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-401055d0-0bbe-44f7-bf98-02606d877838 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:48.428879 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-401055d0-0bbe-44f7-bf98-02606d877838 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:48.429326 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-401055d0-0bbe-44f7-bf98-02606d877838 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:48.572406 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-401055d0-0bbe-44f7-bf98-02606d877838 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:20:48.579829 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-401055d0-0bbe-44f7-bf98-02606d877838 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8" status: 200 len: 1266 microversion: 2.1 time: 0.163450 Jul 05 16:20:48.582601 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 628/1067] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:20:48 2022] GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:20:49.596552 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-f912f541-0c54-4e22-b953-32ef18d81997 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:20:49.597211 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-f912f541-0c54-4e22-b953-32ef18d81997 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:20:49.603655 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f912f541-0c54-4e22-b953-32ef18d81997 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:49.604108 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f912f541-0c54-4e22-b953-32ef18d81997 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:49.604912 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f912f541-0c54-4e22-b953-32ef18d81997 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:49.605364 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f912f541-0c54-4e22-b953-32ef18d81997 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:49.735280 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-f912f541-0c54-4e22-b953-32ef18d81997 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:20:49.742983 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-f912f541-0c54-4e22-b953-32ef18d81997 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8" status: 200 len: 1266 microversion: 2.1 time: 0.150378 Jul 05 16:20:49.743558 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 629/1068] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:20:49 2022] GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:20:50.245174 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-678dcce2-42ef-40a2-b697-2882f6e4293d req-ed7ac710-3454-4235-aa03-651c6c77836b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8", "name": "network-vif-plugged", "status": "completed", "tag": "a26b2bfa-904b-45ed-bb37-bf3fd116ea36"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:20:50.253226 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-678dcce2-42ef-40a2-b697-2882f6e4293d req-ed7ac710-3454-4235-aa03-651c6c77836b service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:50.253678 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-678dcce2-42ef-40a2-b697-2882f6e4293d req-ed7ac710-3454-4235-aa03-651c6c77836b service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:50.265328 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-678dcce2-42ef-40a2-b697-2882f6e4293d req-ed7ac710-3454-4235-aa03-651c6c77836b service nova] Creating event network-vif-plugged:a26b2bfa-904b-45ed-bb37-bf3fd116ea36 for instance f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 on hv-cinder-84875 Jul 05 16:20:50.270337 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-678dcce2-42ef-40a2-b697-2882f6e4293d req-ed7ac710-3454-4235-aa03-651c6c77836b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210619 Jul 05 16:20:50.273944 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 630/1069] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:20:50.761146 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-69f9f657-3c23-4c89-a75e-df39e37170b9 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:20:50.761857 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-69f9f657-3c23-4c89-a75e-df39e37170b9 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:20:50.768146 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-69f9f657-3c23-4c89-a75e-df39e37170b9 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:50.768600 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-69f9f657-3c23-4c89-a75e-df39e37170b9 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:50.769403 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-69f9f657-3c23-4c89-a75e-df39e37170b9 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:50.769839 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-69f9f657-3c23-4c89-a75e-df39e37170b9 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:50.903565 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-69f9f657-3c23-4c89-a75e-df39e37170b9 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:20:50.911011 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-69f9f657-3c23-4c89-a75e-df39e37170b9 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8" status: 200 len: 1266 microversion: 2.1 time: 0.155237 Jul 05 16:20:50.911585 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 631/1070] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:20:50 2022] GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:20:51.927611 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-edb5b79e-520d-40b4-bf15-5ff2ef4b9f68 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:20:51.928304 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-edb5b79e-520d-40b4-bf15-5ff2ef4b9f68 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:20:51.934746 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-edb5b79e-520d-40b4-bf15-5ff2ef4b9f68 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:51.935205 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-edb5b79e-520d-40b4-bf15-5ff2ef4b9f68 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:51.935981 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-edb5b79e-520d-40b4-bf15-5ff2ef4b9f68 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:51.936428 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-edb5b79e-520d-40b4-bf15-5ff2ef4b9f68 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:52.067472 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-edb5b79e-520d-40b4-bf15-5ff2ef4b9f68 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:20:52.075571 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-edb5b79e-520d-40b4-bf15-5ff2ef4b9f68 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8" status: 200 len: 1266 microversion: 2.1 time: 0.152070 Jul 05 16:20:52.076146 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 632/1071] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:20:51 2022] GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:20:53.092728 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-0a35ef15-89b3-4910-a649-cc6de37f23c2 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:20:53.093414 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-0a35ef15-89b3-4910-a649-cc6de37f23c2 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:20:53.099804 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0a35ef15-89b3-4910-a649-cc6de37f23c2 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:53.100256 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0a35ef15-89b3-4910-a649-cc6de37f23c2 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:53.101116 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0a35ef15-89b3-4910-a649-cc6de37f23c2 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:53.101559 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0a35ef15-89b3-4910-a649-cc6de37f23c2 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:53.229500 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-0a35ef15-89b3-4910-a649-cc6de37f23c2 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:20:53.237259 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-0a35ef15-89b3-4910-a649-cc6de37f23c2 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8" status: 200 len: 1453 microversion: 2.1 time: 0.148426 Jul 05 16:20:53.237835 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 633/1072] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:20:53 2022] GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:20:53.252412 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-973a72e5-a940-4467-ab83-1761b416bead tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:20:53.253053 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-973a72e5-a940-4467-ab83-1761b416bead tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:20:53.259131 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-973a72e5-a940-4467-ab83-1761b416bead tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:53.259581 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-973a72e5-a940-4467-ab83-1761b416bead tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:53.260338 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-973a72e5-a940-4467-ab83-1761b416bead tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:53.260790 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-973a72e5-a940-4467-ab83-1761b416bead tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:53.390864 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-973a72e5-a940-4467-ab83-1761b416bead tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:20:53.398403 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-973a72e5-a940-4467-ab83-1761b416bead tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8" status: 200 len: 1453 microversion: 2.1 time: 0.149425 Jul 05 16:20:53.399518 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 634/1073] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:20:53 2022] GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:20:55.640225 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-68127101-a948-4fa8-a41a-62b860593f8b req-2a5fecb2-3ed8-410c-ba1b-81ff2205592f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8", "tag": "a26b2bfa-904b-45ed-bb37-bf3fd116ea36"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:20:55.648722 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-68127101-a948-4fa8-a41a-62b860593f8b req-2a5fecb2-3ed8-410c-ba1b-81ff2205592f service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:20:55.649199 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-68127101-a948-4fa8-a41a-62b860593f8b req-2a5fecb2-3ed8-410c-ba1b-81ff2205592f service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:20:55.660306 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-68127101-a948-4fa8-a41a-62b860593f8b req-2a5fecb2-3ed8-410c-ba1b-81ff2205592f service nova] Creating event network-changed:a26b2bfa-904b-45ed-bb37-bf3fd116ea36 for instance f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 on hv-cinder-84875 Jul 05 16:20:55.666421 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-68127101-a948-4fa8-a41a-62b860593f8b req-2a5fecb2-3ed8-410c-ba1b-81ff2205592f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029894 Jul 05 16:20:55.667411 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 635/1074] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:21:02.080689 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 16:21:02.081299 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Tue Jul 5 16:21:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 (ip 10.222.0.45) !!! Jul 05 16:22:20.719438 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 16:22:20.720226 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Tue Jul 5 16:22:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 (ip 10.222.0.45) !!! Jul 05 16:22:49.758909 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ddbb875c-c160-4bf6-88bf-f54883c16b80] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 05 16:22:49.759605 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:22:49.760352 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=46 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:22:49.764474 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-f98d67f7-7332-41ab-b0b1-37227a2fdbe8 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:22:49.765096 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-f98d67f7-7332-41ab-b0b1-37227a2fdbe8 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:22:49.771068 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f98d67f7-7332-41ab-b0b1-37227a2fdbe8 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:22:49.773901 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f98d67f7-7332-41ab-b0b1-37227a2fdbe8 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:22:49.773901 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f98d67f7-7332-41ab-b0b1-37227a2fdbe8 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:22:49.773901 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f98d67f7-7332-41ab-b0b1-37227a2fdbe8 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:22:49.798415 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-f98d67f7-7332-41ab-b0b1-37227a2fdbe8 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8] Going to try to terminate instance {{(pid=118320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 16:22:50.074501 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-f98d67f7-7332-41ab-b0b1-37227a2fdbe8 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8" status: 204 len: 0 microversion: 2.1 time: 0.318144 Jul 05 16:22:50.075012 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 636/1075] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Jul 5 16:22:49 2022] DELETE /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 05 16:22:50.083287 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-5e78857e-a9d3-4c2d-8712-a747f979ec34 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:22:50.083987 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-5e78857e-a9d3-4c2d-8712-a747f979ec34 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:22:50.089893 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5e78857e-a9d3-4c2d-8712-a747f979ec34 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:22:50.090349 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5e78857e-a9d3-4c2d-8712-a747f979ec34 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:22:50.091119 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5e78857e-a9d3-4c2d-8712-a747f979ec34 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:22:50.091561 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5e78857e-a9d3-4c2d-8712-a747f979ec34 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:22:50.231089 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-5e78857e-a9d3-4c2d-8712-a747f979ec34 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:22:50.238814 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-5e78857e-a9d3-4c2d-8712-a747f979ec34 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8" status: 200 len: 1578 microversion: 2.1 time: 0.159461 Jul 05 16:22:50.239381 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 637/1076] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:22:50 2022] GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:22:51.256304 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-1517d229-2013-4ba7-9fe5-178d0171fc8f tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:22:51.256962 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-1517d229-2013-4ba7-9fe5-178d0171fc8f tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:22:51.267465 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1517d229-2013-4ba7-9fe5-178d0171fc8f tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:22:51.267784 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1517d229-2013-4ba7-9fe5-178d0171fc8f tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:22:51.268582 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1517d229-2013-4ba7-9fe5-178d0171fc8f tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:22:51.269042 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1517d229-2013-4ba7-9fe5-178d0171fc8f tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:22:51.274691 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO oslo.messaging._drivers.impl_rabbit [-] [ddbb875c-c160-4bf6-88bf-f54883c16b80] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 50664. Jul 05 16:22:51.402790 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-1517d229-2013-4ba7-9fe5-178d0171fc8f tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:22:51.410299 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-1517d229-2013-4ba7-9fe5-178d0171fc8f tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8" status: 200 len: 1578 microversion: 2.1 time: 0.158756 Jul 05 16:22:51.410863 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 638/1077] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:22:51 2022] GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:22:52.427657 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-553fa696-735a-4977-95fd-594debc94003 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:22:52.428149 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-553fa696-735a-4977-95fd-594debc94003 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:22:52.437662 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-553fa696-735a-4977-95fd-594debc94003 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:22:52.437662 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-553fa696-735a-4977-95fd-594debc94003 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:22:52.437662 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-553fa696-735a-4977-95fd-594debc94003 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:22:52.437662 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-553fa696-735a-4977-95fd-594debc94003 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:22:52.529092 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-553fa696-735a-4977-95fd-594debc94003 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:22:52.536720 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-553fa696-735a-4977-95fd-594debc94003 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8" status: 200 len: 1510 microversion: 2.1 time: 0.113191 Jul 05 16:22:52.537477 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 639/1078] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:22:52 2022] GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 => generated 1510 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:22:52.784833 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-ae5b1ea2-c4b7-49c9-b83f-48f665aa850a req-5ce56bdf-0ce4-4d00-98bf-e8339c5f04a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8", "name": "network-vif-deleted", "tag": "a26b2bfa-904b-45ed-bb37-bf3fd116ea36"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:22:52.793502 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-ae5b1ea2-c4b7-49c9-b83f-48f665aa850a req-5ce56bdf-0ce4-4d00-98bf-e8339c5f04a3 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:22:52.793960 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-ae5b1ea2-c4b7-49c9-b83f-48f665aa850a req-5ce56bdf-0ce4-4d00-98bf-e8339c5f04a3 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:22:52.812365 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-ae5b1ea2-c4b7-49c9-b83f-48f665aa850a req-5ce56bdf-0ce4-4d00-98bf-e8339c5f04a3 service nova] Creating event network-vif-deleted:a26b2bfa-904b-45ed-bb37-bf3fd116ea36 for instance f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 on hv-cinder-84875 Jul 05 16:22:52.819742 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-ae5b1ea2-c4b7-49c9-b83f-48f665aa850a req-5ce56bdf-0ce4-4d00-98bf-e8339c5f04a3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038398 Jul 05 16:22:52.822879 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 640/1079] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:22:53.556413 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-e7966143-2c35-44ee-a10b-f15c9fa7391e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:22:53.557066 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-e7966143-2c35-44ee-a10b-f15c9fa7391e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:22:53.563334 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e7966143-2c35-44ee-a10b-f15c9fa7391e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:22:53.563785 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e7966143-2c35-44ee-a10b-f15c9fa7391e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:22:53.564545 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e7966143-2c35-44ee-a10b-f15c9fa7391e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:22:53.565010 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e7966143-2c35-44ee-a10b-f15c9fa7391e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:22:53.595852 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e7966143-2c35-44ee-a10b-f15c9fa7391e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:22:53.596282 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e7966143-2c35-44ee-a10b-f15c9fa7391e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:22:53.596732 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.objects.instance [None req-e7966143-2c35-44ee-a10b-f15c9fa7391e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lazy-loading 'fault' on Instance uuid f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 {{(pid=118320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 16:22:53.639525 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-e7966143-2c35-44ee-a10b-f15c9fa7391e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:22:53.647289 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-e7966143-2c35-44ee-a10b-f15c9fa7391e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8" status: 200 len: 1230 microversion: 2.1 time: 0.096381 Jul 05 16:22:53.647896 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 641/1080] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:22:53 2022] GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:22:54.663428 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-bf3be9a0-be51-41ae-94ad-efccb303f64c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:22:54.664666 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-bf3be9a0-be51-41ae-94ad-efccb303f64c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:22:54.671186 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bf3be9a0-be51-41ae-94ad-efccb303f64c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:22:54.671642 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bf3be9a0-be51-41ae-94ad-efccb303f64c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:22:54.672412 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bf3be9a0-be51-41ae-94ad-efccb303f64c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:22:54.672890 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bf3be9a0-be51-41ae-94ad-efccb303f64c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:22:54.685892 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-bf3be9a0-be51-41ae-94ad-efccb303f64c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] HTTP exception thrown: Instance f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 could not be found. Jul 05 16:22:54.687499 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-bf3be9a0-be51-41ae-94ad-efccb303f64c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Request method failure captured: Jul 05 16:22:54.687499 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 HTTP/1.1 Jul 05 16:22:54.687499 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:22:54.687499 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:22:54.687499 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:22:54.687499 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:22:54.687499 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:22:54.687499 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:22:54.687499 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:22:54.687499 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:22:54.687499 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGS5cHux0_5KVsliMHIxj7KjpuGF_grk3k2eQrue6KTMeaK4-HqMUO0gwWi0DPP1dfVotrRrgjYuIGKi8Jkqg75X752EKsPCvXektFNRT_xGyd7lplJ64TVk6hun_S1JiSqiARovrEqslD_BJ3G4lUUOjrXpQ9TF2s6cZ_araj5MAao Jul 05 16:22:54.687499 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:22:54.687499 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:22:54.687499 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:22:54.687499 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:22:54.687499 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:22:54.687499 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:22:54.687499 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 85bf8c1d40a04aaf9e46cd7f1e58048a Jul 05 16:22:54.687499 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-TestVolumeBootPattern-801191980 Jul 05 16:22:54.687499 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:22:54.687499 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:22:54.689216 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_85bf8c1d40a04aaf9e46cd7f1e58048a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/85bf8c1d40a04aaf9e46cd7f1e58048a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/85bf8c1d40a04aaf9e46cd7f1e58048a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/85bf8c1d40a04aaf9e46cd7f1e58048a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:22:54.689216 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-TestVolumeBootPattern-801191980 Jul 05 16:22:54.689216 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 85bf8c1d40a04aaf9e46cd7f1e58048a Jul 05 16:22:54.689216 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-TestVolumeBootPattern-801191980 Jul 05 16:22:54.689216 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-TestVolumeBootPattern-801191980-project Jul 05 16:22:54.689216 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:22:54.689216 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:22:54.689216 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: b1cf6897a2a74b7c84b26bae868845f4 Jul 05 16:22:54.689216 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-TestVolumeBootPattern-801191980-project Jul 05 16:22:54.689216 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:22:54.689216 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 could not be found. Jul 05 16:22:54.689216 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': 'f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8'} Jul 05 16:22:54.690209 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:22:54.690209 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:22:54.690209 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:22:54.690209 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:22:54.690209 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:22:54.690209 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:22:54.690209 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:22:54.690209 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:22:54.690209 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:22:54.690209 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:22:54.690209 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 could not be found. Jul 05 16:22:54.690209 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:22:54.690209 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:22:54.690209 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:22:54.690209 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:22:54.690209 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:22:54.690209 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:22:54.690209 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:22:54.690209 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:22:54.690209 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:22:54.691811 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:22:54.691811 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 16:22:54.691811 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 16:22:54.691811 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:22:54.691811 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:22:54.691811 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:22:54.691811 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:22:54.691811 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 could not be found. Jul 05 16:22:54.691811 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:22:54.691811 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:22:54.691811 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:22:54.691811 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:22:54.691811 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:22:54.691811 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:22:54.691811 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:22:54.691811 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:22:54.691811 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 could not be found. Jul 05 16:22:54.691811 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:22:54.693289 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-bf3be9a0-be51-41ae-94ad-efccb303f64c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Returning 404 to user: Instance f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:22:54.693289 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-bf3be9a0-be51-41ae-94ad-efccb303f64c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8" status: 404 len: 111 microversion: 2.1 time: 0.029360 Jul 05 16:22:54.693289 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 642/1081] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:22:54 2022] GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 16:22:54.781082 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-4c6e14cd-27ef-4e6f-8a38-414c07183442 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1749512442", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1168178998", "security_groups": [{"name": "tempest-secgroup-smoke-1594892166"}], "block_device_mapping_v2": [{"uuid": "5701c46e-3bcb-4646-aa8c-b744f31a98f4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9e6fae8e-72c3-49ba-ab85-7183288aac1f"}]}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:22:54.892954 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.network.neutron [None req-4c6e14cd-27ef-4e6f-8a38-414c07183442 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] validate_networks() for [('9e6fae8e-72c3-49ba-ab85-7183288aac1f', None, None, None, None, None)] {{(pid=118320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 16:22:55.247888 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-4c6e14cd-27ef-4e6f-8a38-414c07183442 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Flavor limits 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 16:22:55.248319 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-4c6e14cd-27ef-4e6f-8a38-414c07183442 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Image limits 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 16:22:55.248833 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-4c6e14cd-27ef-4e6f-8a38-414c07183442 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Flavor pref 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 16:22:55.249260 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-4c6e14cd-27ef-4e6f-8a38-414c07183442 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Image pref 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 16:22:55.249682 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-4c6e14cd-27ef-4e6f-8a38-414c07183442 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 16:22:55.258573 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4c6e14cd-27ef-4e6f-8a38-414c07183442 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:22:55.259093 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4c6e14cd-27ef-4e6f-8a38-414c07183442 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:22:55.259909 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4c6e14cd-27ef-4e6f-8a38-414c07183442 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:22:55.260384 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4c6e14cd-27ef-4e6f-8a38-414c07183442 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:22:55.277040 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-4c6e14cd-27ef-4e6f-8a38-414c07183442 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Getting quotas for project 85bf8c1d40a04aaf9e46cd7f1e58048a. Resources: {'ram', 'instances', 'cores'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:22:55.281057 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-4c6e14cd-27ef-4e6f-8a38-414c07183442 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Getting quotas for user b1cf6897a2a74b7c84b26bae868845f4 and project 85bf8c1d40a04aaf9e46cd7f1e58048a. Resources: {'ram', 'instances', 'cores'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:22:55.337004 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-4c6e14cd-27ef-4e6f-8a38-414c07183442 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Going to run 1 instances... {{(pid=118320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 16:22:55.339095 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-4c6e14cd-27ef-4e6f-8a38-414c07183442 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: afba3565-7b71-4a48-a24a-1a42f118be22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5701c46e-3bcb-4646-aa8c-b744f31a98f4',volume_size=None,volume_type=None)] {{(pid=118320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 16:22:55.740161 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-4c6e14cd-27ef-4e6f-8a38-414c07183442 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.962900 Jul 05 16:22:55.741117 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 643/1082] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Jul 5 16:22:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 05 16:22:55.751440 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-5dd9ff8b-001f-42ef-aca3-ce883d9106f4 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:22:55.752091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-5dd9ff8b-001f-42ef-aca3-ce883d9106f4 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: afba3565-7b71-4a48-a24a-1a42f118be22] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:22:55.806385 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-5dd9ff8b-001f-42ef-aca3-ce883d9106f4 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:22:55.812984 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-5dd9ff8b-001f-42ef-aca3-ce883d9106f4 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22" status: 200 len: 1095 microversion: 2.1 time: 0.065398 Jul 05 16:22:55.813526 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 644/1083] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:22:55 2022] GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:22:56.830306 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-c85df861-1ca0-4f6d-817c-ab75513cdfbe tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:22:56.830977 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-c85df861-1ca0-4f6d-817c-ab75513cdfbe tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: afba3565-7b71-4a48-a24a-1a42f118be22] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:22:56.837951 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c85df861-1ca0-4f6d-817c-ab75513cdfbe tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:22:56.838416 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c85df861-1ca0-4f6d-817c-ab75513cdfbe tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:22:56.839190 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c85df861-1ca0-4f6d-817c-ab75513cdfbe tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:22:56.839629 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c85df861-1ca0-4f6d-817c-ab75513cdfbe tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:22:56.902170 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c85df861-1ca0-4f6d-817c-ab75513cdfbe tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:22:56.909636 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-c85df861-1ca0-4f6d-817c-ab75513cdfbe tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22" status: 200 len: 1137 microversion: 2.1 time: 0.083290 Jul 05 16:22:56.910210 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 645/1084] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:22:56 2022] GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22 => generated 1137 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:22:57.927544 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-032d025a-ce75-443c-b83d-44318efcffbd tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:22:57.928221 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-032d025a-ce75-443c-b83d-44318efcffbd tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: afba3565-7b71-4a48-a24a-1a42f118be22] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:22:57.935187 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-032d025a-ce75-443c-b83d-44318efcffbd tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:22:57.938408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-032d025a-ce75-443c-b83d-44318efcffbd tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:22:57.938408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-032d025a-ce75-443c-b83d-44318efcffbd tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:22:57.938408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-032d025a-ce75-443c-b83d-44318efcffbd tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:22:58.023235 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-032d025a-ce75-443c-b83d-44318efcffbd tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:22:58.030866 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-032d025a-ce75-443c-b83d-44318efcffbd tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22" status: 200 len: 1211 microversion: 2.1 time: 0.107213 Jul 05 16:22:58.031436 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 646/1085] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:22:57 2022] GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22 => generated 1211 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:22:59.048424 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-41ba869d-b9d4-4ea1-82bf-f0a714dd2e2d tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:22:59.049136 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-41ba869d-b9d4-4ea1-82bf-f0a714dd2e2d tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: afba3565-7b71-4a48-a24a-1a42f118be22] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:22:59.055370 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-41ba869d-b9d4-4ea1-82bf-f0a714dd2e2d tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:22:59.055820 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-41ba869d-b9d4-4ea1-82bf-f0a714dd2e2d tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:22:59.062007 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-41ba869d-b9d4-4ea1-82bf-f0a714dd2e2d tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:22:59.062007 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-41ba869d-b9d4-4ea1-82bf-f0a714dd2e2d tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:22:59.247473 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-41ba869d-b9d4-4ea1-82bf-f0a714dd2e2d tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:22:59.255498 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-41ba869d-b9d4-4ea1-82bf-f0a714dd2e2d tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22" status: 200 len: 1267 microversion: 2.1 time: 0.210830 Jul 05 16:22:59.255915 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 647/1086] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:22:59 2022] GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22 => generated 1267 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:22:59.261330 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-03c04a73-894d-44a5-951c-f7884584358f req-f40e09e9-d35b-49a6-9e47-6d08b6cbe88a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afba3565-7b71-4a48-a24a-1a42f118be22", "tag": "23599f51-0ae0-4fa3-921f-4883717fbde6"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:22:59.269282 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-03c04a73-894d-44a5-951c-f7884584358f req-f40e09e9-d35b-49a6-9e47-6d08b6cbe88a service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:22:59.269732 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-03c04a73-894d-44a5-951c-f7884584358f req-f40e09e9-d35b-49a6-9e47-6d08b6cbe88a service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:22:59.280433 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-03c04a73-894d-44a5-951c-f7884584358f req-f40e09e9-d35b-49a6-9e47-6d08b6cbe88a service nova] Creating event network-changed:23599f51-0ae0-4fa3-921f-4883717fbde6 for instance afba3565-7b71-4a48-a24a-1a42f118be22 on hv-cinder-84875 Jul 05 16:22:59.285379 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-03c04a73-894d-44a5-951c-f7884584358f req-f40e09e9-d35b-49a6-9e47-6d08b6cbe88a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028335 Jul 05 16:22:59.286333 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 648/1087] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:23:00.275132 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-037110d6-05c1-4d05-8b2f-0d01acdecf9d tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:23:00.275852 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-037110d6-05c1-4d05-8b2f-0d01acdecf9d tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: afba3565-7b71-4a48-a24a-1a42f118be22] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:23:00.282137 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-037110d6-05c1-4d05-8b2f-0d01acdecf9d tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:23:00.282552 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-037110d6-05c1-4d05-8b2f-0d01acdecf9d tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:23:00.283458 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-037110d6-05c1-4d05-8b2f-0d01acdecf9d tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:23:00.283953 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-037110d6-05c1-4d05-8b2f-0d01acdecf9d tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:23:00.410809 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-037110d6-05c1-4d05-8b2f-0d01acdecf9d tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:23:00.418138 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-037110d6-05c1-4d05-8b2f-0d01acdecf9d tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22" status: 200 len: 1267 microversion: 2.1 time: 0.148365 Jul 05 16:23:00.418702 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 649/1088] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:23:00 2022] GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:23:01.435445 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-78e16291-352e-49cc-99ea-c76f7dcac28b tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:23:01.436106 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-78e16291-352e-49cc-99ea-c76f7dcac28b tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: afba3565-7b71-4a48-a24a-1a42f118be22] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:23:01.442701 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-78e16291-352e-49cc-99ea-c76f7dcac28b tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:23:01.443155 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-78e16291-352e-49cc-99ea-c76f7dcac28b tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:23:01.443930 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-78e16291-352e-49cc-99ea-c76f7dcac28b tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:23:01.444372 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-78e16291-352e-49cc-99ea-c76f7dcac28b tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:23:01.577608 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-78e16291-352e-49cc-99ea-c76f7dcac28b tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:23:01.585020 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-78e16291-352e-49cc-99ea-c76f7dcac28b tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22" status: 200 len: 1267 microversion: 2.1 time: 0.154391 Jul 05 16:23:01.585594 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 650/1089] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:23:01 2022] GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:23:02.601712 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-8a953c5c-83f3-4e84-9a35-ef52e23a2ccd tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:23:02.602403 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-8a953c5c-83f3-4e84-9a35-ef52e23a2ccd tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: afba3565-7b71-4a48-a24a-1a42f118be22] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:23:02.608830 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8a953c5c-83f3-4e84-9a35-ef52e23a2ccd tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:23:02.609285 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8a953c5c-83f3-4e84-9a35-ef52e23a2ccd tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:23:02.610047 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8a953c5c-83f3-4e84-9a35-ef52e23a2ccd tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:23:02.610481 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8a953c5c-83f3-4e84-9a35-ef52e23a2ccd tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:23:02.736801 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-8a953c5c-83f3-4e84-9a35-ef52e23a2ccd tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:23:02.744110 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-8a953c5c-83f3-4e84-9a35-ef52e23a2ccd tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22" status: 200 len: 1267 microversion: 2.1 time: 0.146317 Jul 05 16:23:02.744684 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 651/1090] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:23:02 2022] GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:23:03.761495 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-d445e96a-7e85-42d1-b428-cf9da222094c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:23:03.762108 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-d445e96a-7e85-42d1-b428-cf9da222094c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: afba3565-7b71-4a48-a24a-1a42f118be22] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:23:03.768574 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d445e96a-7e85-42d1-b428-cf9da222094c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:23:03.769055 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d445e96a-7e85-42d1-b428-cf9da222094c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:23:03.769821 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d445e96a-7e85-42d1-b428-cf9da222094c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:23:03.770259 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d445e96a-7e85-42d1-b428-cf9da222094c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:23:03.902444 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-d445e96a-7e85-42d1-b428-cf9da222094c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:23:03.909862 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-d445e96a-7e85-42d1-b428-cf9da222094c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22" status: 200 len: 1267 microversion: 2.1 time: 0.152912 Jul 05 16:23:03.910430 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 652/1091] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:23:03 2022] GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:23:04.926876 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-8f290be9-d04a-418d-808f-fe98c3fbcec1 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:23:04.927555 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-8f290be9-d04a-418d-808f-fe98c3fbcec1 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: afba3565-7b71-4a48-a24a-1a42f118be22] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:23:04.934602 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8f290be9-d04a-418d-808f-fe98c3fbcec1 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:23:04.935056 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8f290be9-d04a-418d-808f-fe98c3fbcec1 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:23:04.935820 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8f290be9-d04a-418d-808f-fe98c3fbcec1 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:23:04.936261 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-8f290be9-d04a-418d-808f-fe98c3fbcec1 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:23:05.063679 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-8f290be9-d04a-418d-808f-fe98c3fbcec1 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:23:05.072042 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-8f290be9-d04a-418d-808f-fe98c3fbcec1 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22" status: 200 len: 1267 microversion: 2.1 time: 0.149086 Jul 05 16:23:05.072602 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 653/1092] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:23:04 2022] GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:23:06.088518 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-bc3dfcb9-789a-4057-9c7a-d7a83d74b85a tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:23:06.089215 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-bc3dfcb9-789a-4057-9c7a-d7a83d74b85a tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: afba3565-7b71-4a48-a24a-1a42f118be22] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:23:06.091059 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell0:SELECT=2 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:23:06.091733 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell0:SELECT=8 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:23:06.097001 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bc3dfcb9-789a-4057-9c7a-d7a83d74b85a tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:23:06.097450 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bc3dfcb9-789a-4057-9c7a-d7a83d74b85a tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:23:06.098210 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bc3dfcb9-789a-4057-9c7a-d7a83d74b85a tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:23:06.098690 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bc3dfcb9-789a-4057-9c7a-d7a83d74b85a tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:23:06.102955 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:23:06.232630 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-bc3dfcb9-789a-4057-9c7a-d7a83d74b85a tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:23:06.240174 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-bc3dfcb9-789a-4057-9c7a-d7a83d74b85a tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22" status: 200 len: 1267 microversion: 2.1 time: 0.155551 Jul 05 16:23:06.240815 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 654/1093] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:23:06 2022] GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:23:07.258082 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-c5ed8c0b-1394-4f92-972b-b186308edb85 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:23:07.259205 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-c5ed8c0b-1394-4f92-972b-b186308edb85 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: afba3565-7b71-4a48-a24a-1a42f118be22] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:23:07.265770 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c5ed8c0b-1394-4f92-972b-b186308edb85 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:23:07.266225 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c5ed8c0b-1394-4f92-972b-b186308edb85 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:23:07.266991 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c5ed8c0b-1394-4f92-972b-b186308edb85 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:23:07.267433 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-c5ed8c0b-1394-4f92-972b-b186308edb85 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:23:07.396030 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-c5ed8c0b-1394-4f92-972b-b186308edb85 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:23:07.403578 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-c5ed8c0b-1394-4f92-972b-b186308edb85 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22" status: 200 len: 1267 microversion: 2.1 time: 0.149940 Jul 05 16:23:07.404280 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 655/1094] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:23:07 2022] GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:23:08.419999 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-425a70b6-5d2e-415c-9e13-00d7f19ecfd6 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:23:08.420618 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-425a70b6-5d2e-415c-9e13-00d7f19ecfd6 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: afba3565-7b71-4a48-a24a-1a42f118be22] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:23:08.427185 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-425a70b6-5d2e-415c-9e13-00d7f19ecfd6 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:23:08.427640 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-425a70b6-5d2e-415c-9e13-00d7f19ecfd6 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:23:08.428406 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-425a70b6-5d2e-415c-9e13-00d7f19ecfd6 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:23:08.428881 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-425a70b6-5d2e-415c-9e13-00d7f19ecfd6 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:23:08.571995 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-425a70b6-5d2e-415c-9e13-00d7f19ecfd6 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:23:08.579621 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-425a70b6-5d2e-415c-9e13-00d7f19ecfd6 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22" status: 200 len: 1267 microversion: 2.1 time: 0.163489 Jul 05 16:23:08.580392 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 656/1095] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:23:08 2022] GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:23:09.596356 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-600e59e2-7a8b-48cd-a428-f34c238e6be3 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:23:09.597021 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-600e59e2-7a8b-48cd-a428-f34c238e6be3 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: afba3565-7b71-4a48-a24a-1a42f118be22] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:23:09.603997 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-600e59e2-7a8b-48cd-a428-f34c238e6be3 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:23:09.604441 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-600e59e2-7a8b-48cd-a428-f34c238e6be3 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:23:09.605230 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-600e59e2-7a8b-48cd-a428-f34c238e6be3 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:23:09.605666 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-600e59e2-7a8b-48cd-a428-f34c238e6be3 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:23:09.736126 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-600e59e2-7a8b-48cd-a428-f34c238e6be3 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:23:09.743489 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-600e59e2-7a8b-48cd-a428-f34c238e6be3 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22" status: 200 len: 1267 microversion: 2.1 time: 0.151119 Jul 05 16:23:09.744055 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 657/1096] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:23:09 2022] GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:23:10.737743 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-6f229103-3f64-4ac0-9dbf-a0e1b4f1235f req-b72c19a4-2994-46b7-b025-d0ebf748db6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afba3565-7b71-4a48-a24a-1a42f118be22", "name": "network-vif-plugged", "status": "completed", "tag": "23599f51-0ae0-4fa3-921f-4883717fbde6"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:23:10.746566 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-6f229103-3f64-4ac0-9dbf-a0e1b4f1235f req-b72c19a4-2994-46b7-b025-d0ebf748db6b service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:23:10.747077 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-6f229103-3f64-4ac0-9dbf-a0e1b4f1235f req-b72c19a4-2994-46b7-b025-d0ebf748db6b service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:23:10.757785 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-6f229103-3f64-4ac0-9dbf-a0e1b4f1235f req-b72c19a4-2994-46b7-b025-d0ebf748db6b service nova] Creating event network-vif-plugged:23599f51-0ae0-4fa3-921f-4883717fbde6 for instance afba3565-7b71-4a48-a24a-1a42f118be22 on hv-cinder-84875 Jul 05 16:23:10.762930 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-6f229103-3f64-4ac0-9dbf-a0e1b4f1235f req-b72c19a4-2994-46b7-b025-d0ebf748db6b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029667 Jul 05 16:23:10.763532 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 658/1097] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:23:10.768371 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-f92598df-bcc2-4604-b361-ccce155fc91c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:23:10.769190 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-f92598df-bcc2-4604-b361-ccce155fc91c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: afba3565-7b71-4a48-a24a-1a42f118be22] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:23:10.775135 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f92598df-bcc2-4604-b361-ccce155fc91c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:23:10.779433 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f92598df-bcc2-4604-b361-ccce155fc91c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:23:10.779433 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f92598df-bcc2-4604-b361-ccce155fc91c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:23:10.779433 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f92598df-bcc2-4604-b361-ccce155fc91c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:23:10.917879 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-f92598df-bcc2-4604-b361-ccce155fc91c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:23:10.925400 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-f92598df-bcc2-4604-b361-ccce155fc91c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22" status: 200 len: 1267 microversion: 2.1 time: 0.160785 Jul 05 16:23:10.925977 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 659/1098] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:23:10 2022] GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:23:11.942759 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-9f98c178-ab5d-4e61-b39a-c11b26968367 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:23:11.943392 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-9f98c178-ab5d-4e61-b39a-c11b26968367 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: afba3565-7b71-4a48-a24a-1a42f118be22] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:23:11.950517 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9f98c178-ab5d-4e61-b39a-c11b26968367 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:23:11.950959 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9f98c178-ab5d-4e61-b39a-c11b26968367 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:23:11.951714 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9f98c178-ab5d-4e61-b39a-c11b26968367 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:23:11.952146 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9f98c178-ab5d-4e61-b39a-c11b26968367 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:23:12.080081 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-9f98c178-ab5d-4e61-b39a-c11b26968367 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:23:12.087588 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-9f98c178-ab5d-4e61-b39a-c11b26968367 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22" status: 200 len: 1267 microversion: 2.1 time: 0.148644 Jul 05 16:23:12.089083 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 660/1099] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:23:11 2022] GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:23:13.106260 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-4f684511-c21e-4a3e-99d0-e1f9a9686ef1 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:23:13.106952 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-4f684511-c21e-4a3e-99d0-e1f9a9686ef1 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: afba3565-7b71-4a48-a24a-1a42f118be22] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:23:13.113589 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4f684511-c21e-4a3e-99d0-e1f9a9686ef1 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:23:13.114048 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4f684511-c21e-4a3e-99d0-e1f9a9686ef1 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:23:13.114818 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4f684511-c21e-4a3e-99d0-e1f9a9686ef1 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:23:13.115268 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-4f684511-c21e-4a3e-99d0-e1f9a9686ef1 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:23:13.249441 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-4f684511-c21e-4a3e-99d0-e1f9a9686ef1 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:23:13.256727 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-4f684511-c21e-4a3e-99d0-e1f9a9686ef1 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22" status: 200 len: 1453 microversion: 2.1 time: 0.154339 Jul 05 16:23:13.257323 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 661/1100] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:23:13 2022] GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:23:13.272270 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-feae091c-c7c9-47dc-a97d-c6808af30c2d tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:23:13.272902 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-feae091c-c7c9-47dc-a97d-c6808af30c2d tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: afba3565-7b71-4a48-a24a-1a42f118be22] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:23:13.279251 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-feae091c-c7c9-47dc-a97d-c6808af30c2d tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:23:13.279697 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-feae091c-c7c9-47dc-a97d-c6808af30c2d tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:23:13.280490 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-feae091c-c7c9-47dc-a97d-c6808af30c2d tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:23:13.280957 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-feae091c-c7c9-47dc-a97d-c6808af30c2d tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:23:13.409472 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-feae091c-c7c9-47dc-a97d-c6808af30c2d tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:23:13.417597 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-feae091c-c7c9-47dc-a97d-c6808af30c2d tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22" status: 200 len: 1453 microversion: 2.1 time: 0.148761 Jul 05 16:23:13.418170 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 662/1101] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:23:13 2022] GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:23:15.493734 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-4971b167-6c27-4110-a93c-64ddf12a61e6 req-bbff0496-ed50-4d29-8e21-a6652ae26198 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afba3565-7b71-4a48-a24a-1a42f118be22", "tag": "23599f51-0ae0-4fa3-921f-4883717fbde6"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:23:15.502247 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-4971b167-6c27-4110-a93c-64ddf12a61e6 req-bbff0496-ed50-4d29-8e21-a6652ae26198 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:23:15.502688 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-4971b167-6c27-4110-a93c-64ddf12a61e6 req-bbff0496-ed50-4d29-8e21-a6652ae26198 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:23:15.514260 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-4971b167-6c27-4110-a93c-64ddf12a61e6 req-bbff0496-ed50-4d29-8e21-a6652ae26198 service nova] Creating event network-changed:23599f51-0ae0-4fa3-921f-4883717fbde6 for instance afba3565-7b71-4a48-a24a-1a42f118be22 on hv-cinder-84875 Jul 05 16:23:15.518997 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-4971b167-6c27-4110-a93c-64ddf12a61e6 req-bbff0496-ed50-4d29-8e21-a6652ae26198 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028926 Jul 05 16:23:15.519716 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 663/1102] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:23:56.665956 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 16:23:56.666628 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Tue Jul 5 16:23:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 05 16:24:02.005441 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 16:24:02.006032 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Tue Jul 5 16:24:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 (ip 10.222.0.45) !!! Jul 05 16:24:22.089047 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 16:24:22.089749 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Tue Jul 5 16:24:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 (ip 10.222.0.45) !!! Jul 05 16:24:49.862743 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:24:49.863491 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=50 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:24:49.867890 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-351ad29b-7c5e-442e-b686-d32d9d9bfb7e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-324369115", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1168178998", "security_groups": [{"name": "tempest-secgroup-smoke-1594892166"}], "block_device_mapping_v2": [{"uuid": "1509dba1-13a4-4c51-8257-1c3243cb8194", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9e6fae8e-72c3-49ba-ab85-7183288aac1f"}]}} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:24:50.130770 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.network.neutron [None req-351ad29b-7c5e-442e-b686-d32d9d9bfb7e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] validate_networks() for [('9e6fae8e-72c3-49ba-ab85-7183288aac1f', None, None, None, None, None)] {{(pid=118320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 16:24:50.491812 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-351ad29b-7c5e-442e-b686-d32d9d9bfb7e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Flavor limits 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 16:24:50.492241 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-351ad29b-7c5e-442e-b686-d32d9d9bfb7e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Image limits 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 16:24:50.492718 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-351ad29b-7c5e-442e-b686-d32d9d9bfb7e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Flavor pref 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 16:24:50.493190 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-351ad29b-7c5e-442e-b686-d32d9d9bfb7e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Image pref 0:0:0 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 16:24:50.493610 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.virt.hardware [None req-351ad29b-7c5e-442e-b686-d32d9d9bfb7e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 16:24:50.503616 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-351ad29b-7c5e-442e-b686-d32d9d9bfb7e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:24:50.504077 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-351ad29b-7c5e-442e-b686-d32d9d9bfb7e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:24:50.504916 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-351ad29b-7c5e-442e-b686-d32d9d9bfb7e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:24:50.505364 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-351ad29b-7c5e-442e-b686-d32d9d9bfb7e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:24:50.522296 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-351ad29b-7c5e-442e-b686-d32d9d9bfb7e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Getting quotas for project 85bf8c1d40a04aaf9e46cd7f1e58048a. Resources: {'ram', 'instances', 'cores'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 16:24:50.526263 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.quota [None req-351ad29b-7c5e-442e-b686-d32d9d9bfb7e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Getting quotas for user b1cf6897a2a74b7c84b26bae868845f4 and project 85bf8c1d40a04aaf9e46cd7f1e58048a. Resources: {'ram', 'instances', 'cores'} {{(pid=118320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 16:24:50.582480 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-351ad29b-7c5e-442e-b686-d32d9d9bfb7e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Going to run 1 instances... {{(pid=118320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 16:24:50.584674 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-351ad29b-7c5e-442e-b686-d32d9d9bfb7e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: 006b2255-2bfc-4f4d-808b-cf33efce0d3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1509dba1-13a4-4c51-8257-1c3243cb8194',volume_size=None,volume_type=None)] {{(pid=118320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 16:24:50.958881 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-351ad29b-7c5e-442e-b686-d32d9d9bfb7e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.098371 Jul 05 16:24:50.959798 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 664/1103] 10.222.0.45 () {60 vars in 1146 bytes} [Tue Jul 5 16:24:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 1100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 05 16:24:50.969484 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-7ba7a2fe-83f5-4ecc-8fd6-8146d5ae9172 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:24:50.970161 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-7ba7a2fe-83f5-4ecc-8fd6-8146d5ae9172 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: 006b2255-2bfc-4f4d-808b-cf33efce0d3b] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:24:51.022731 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-7ba7a2fe-83f5-4ecc-8fd6-8146d5ae9172 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:24:51.029962 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-7ba7a2fe-83f5-4ecc-8fd6-8146d5ae9172 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b" status: 200 len: 1094 microversion: 2.1 time: 0.064153 Jul 05 16:24:51.030723 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 665/1104] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:24:50 2022] GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:24:52.047124 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-e6378e11-eb38-450d-b106-6efe4d8d6dda tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:24:52.047749 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-e6378e11-eb38-450d-b106-6efe4d8d6dda tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: 006b2255-2bfc-4f4d-808b-cf33efce0d3b] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:24:52.054279 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e6378e11-eb38-450d-b106-6efe4d8d6dda tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:24:52.054737 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e6378e11-eb38-450d-b106-6efe4d8d6dda tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:24:52.055512 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e6378e11-eb38-450d-b106-6efe4d8d6dda tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:24:52.055956 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-e6378e11-eb38-450d-b106-6efe4d8d6dda tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:24:52.116117 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-e6378e11-eb38-450d-b106-6efe4d8d6dda tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:24:52.123546 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-e6378e11-eb38-450d-b106-6efe4d8d6dda tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b" status: 200 len: 1136 microversion: 2.1 time: 0.080873 Jul 05 16:24:52.124113 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 666/1105] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:24:52 2022] GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b => generated 1136 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:24:53.140504 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-de879f68-67c4-4e65-a476-c8b07a5aeb7e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:24:53.141223 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-de879f68-67c4-4e65-a476-c8b07a5aeb7e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: 006b2255-2bfc-4f4d-808b-cf33efce0d3b] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:24:53.147601 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-de879f68-67c4-4e65-a476-c8b07a5aeb7e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:24:53.148051 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-de879f68-67c4-4e65-a476-c8b07a5aeb7e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:24:53.148871 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-de879f68-67c4-4e65-a476-c8b07a5aeb7e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:24:53.149318 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-de879f68-67c4-4e65-a476-c8b07a5aeb7e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:24:53.227425 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-de879f68-67c4-4e65-a476-c8b07a5aeb7e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:24:53.235370 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-de879f68-67c4-4e65-a476-c8b07a5aeb7e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b" status: 200 len: 1210 microversion: 2.1 time: 0.098777 Jul 05 16:24:53.236210 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 667/1106] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:24:53 2022] GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b => generated 1210 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:24:54.258243 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-37761daf-e25d-4c67-8d28-a0dfcbae3ae8 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:24:54.259316 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-37761daf-e25d-4c67-8d28-a0dfcbae3ae8 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: 006b2255-2bfc-4f4d-808b-cf33efce0d3b] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:24:54.268631 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-37761daf-e25d-4c67-8d28-a0dfcbae3ae8 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:24:54.269116 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-37761daf-e25d-4c67-8d28-a0dfcbae3ae8 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:24:54.269969 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-37761daf-e25d-4c67-8d28-a0dfcbae3ae8 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:24:54.270614 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-37761daf-e25d-4c67-8d28-a0dfcbae3ae8 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:24:54.437888 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-37761daf-e25d-4c67-8d28-a0dfcbae3ae8 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:24:54.445321 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-37761daf-e25d-4c67-8d28-a0dfcbae3ae8 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b" status: 200 len: 1266 microversion: 2.1 time: 0.192013 Jul 05 16:24:54.445890 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 668/1107] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:24:54 2022] GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:24:54.602724 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-6d8bd64a-5614-4dfb-b73d-948fe0bca347 req-218b4d45-2e02-4bcd-ad00-69695b93887e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "006b2255-2bfc-4f4d-808b-cf33efce0d3b", "tag": "bd0e93ea-99c5-40cb-a24f-6c4e5b679729"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:24:54.611820 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-6d8bd64a-5614-4dfb-b73d-948fe0bca347 req-218b4d45-2e02-4bcd-ad00-69695b93887e service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:24:54.620530 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-6d8bd64a-5614-4dfb-b73d-948fe0bca347 req-218b4d45-2e02-4bcd-ad00-69695b93887e service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:24:54.624497 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-6d8bd64a-5614-4dfb-b73d-948fe0bca347 req-218b4d45-2e02-4bcd-ad00-69695b93887e service nova] Creating event network-changed:bd0e93ea-99c5-40cb-a24f-6c4e5b679729 for instance 006b2255-2bfc-4f4d-808b-cf33efce0d3b on hv-cinder-84875 Jul 05 16:24:54.629990 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-6d8bd64a-5614-4dfb-b73d-948fe0bca347 req-218b4d45-2e02-4bcd-ad00-69695b93887e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102968 Jul 05 16:24:54.630588 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 669/1108] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:24:55.465141 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-878cc423-df70-47cd-8470-b920daf3dc94 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:24:55.465856 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-878cc423-df70-47cd-8470-b920daf3dc94 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: 006b2255-2bfc-4f4d-808b-cf33efce0d3b] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:24:55.472470 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-878cc423-df70-47cd-8470-b920daf3dc94 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:24:55.472970 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-878cc423-df70-47cd-8470-b920daf3dc94 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:24:55.473740 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-878cc423-df70-47cd-8470-b920daf3dc94 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:24:55.474179 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-878cc423-df70-47cd-8470-b920daf3dc94 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:24:55.625045 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-878cc423-df70-47cd-8470-b920daf3dc94 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:24:55.632690 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-878cc423-df70-47cd-8470-b920daf3dc94 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b" status: 200 len: 1266 microversion: 2.1 time: 0.171729 Jul 05 16:24:55.633286 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 670/1109] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:24:55 2022] GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:24:56.649723 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-ae334e27-a18a-4e5d-892c-558ccc4a0648 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:24:56.650437 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-ae334e27-a18a-4e5d-892c-558ccc4a0648 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: 006b2255-2bfc-4f4d-808b-cf33efce0d3b] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:24:56.657487 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ae334e27-a18a-4e5d-892c-558ccc4a0648 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:24:56.657933 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ae334e27-a18a-4e5d-892c-558ccc4a0648 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:24:56.658696 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ae334e27-a18a-4e5d-892c-558ccc4a0648 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:24:56.659131 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ae334e27-a18a-4e5d-892c-558ccc4a0648 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:24:56.786091 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-ae334e27-a18a-4e5d-892c-558ccc4a0648 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:24:56.793526 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-ae334e27-a18a-4e5d-892c-558ccc4a0648 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b" status: 200 len: 1266 microversion: 2.1 time: 0.148132 Jul 05 16:24:56.794096 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 671/1110] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:24:56 2022] GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:24:57.811268 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-5ffaaa00-65d4-4b82-abd8-e0f476f8f40c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:24:57.811938 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-5ffaaa00-65d4-4b82-abd8-e0f476f8f40c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: 006b2255-2bfc-4f4d-808b-cf33efce0d3b] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:24:57.818292 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5ffaaa00-65d4-4b82-abd8-e0f476f8f40c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:24:57.818745 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5ffaaa00-65d4-4b82-abd8-e0f476f8f40c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:24:57.819506 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5ffaaa00-65d4-4b82-abd8-e0f476f8f40c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:24:57.819944 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-5ffaaa00-65d4-4b82-abd8-e0f476f8f40c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:24:57.948869 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-5ffaaa00-65d4-4b82-abd8-e0f476f8f40c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:24:57.956841 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-5ffaaa00-65d4-4b82-abd8-e0f476f8f40c tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b" status: 200 len: 1266 microversion: 2.1 time: 0.149977 Jul 05 16:24:57.957416 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 672/1111] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:24:57 2022] GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:24:58.973558 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-ca1d4c07-0aeb-4603-b56b-ad820e0b2045 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:24:58.974212 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-ca1d4c07-0aeb-4603-b56b-ad820e0b2045 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: 006b2255-2bfc-4f4d-808b-cf33efce0d3b] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:24:58.980566 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ca1d4c07-0aeb-4603-b56b-ad820e0b2045 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:24:58.981047 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ca1d4c07-0aeb-4603-b56b-ad820e0b2045 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:24:58.981814 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ca1d4c07-0aeb-4603-b56b-ad820e0b2045 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:24:58.982270 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ca1d4c07-0aeb-4603-b56b-ad820e0b2045 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:24:59.109065 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-ca1d4c07-0aeb-4603-b56b-ad820e0b2045 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:24:59.116624 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-ca1d4c07-0aeb-4603-b56b-ad820e0b2045 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b" status: 200 len: 1266 microversion: 2.1 time: 0.146947 Jul 05 16:24:59.117216 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 673/1112] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:24:58 2022] GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:25:00.133234 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-16858d5d-7330-47bc-ab4b-7ffe97a25197 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:25:00.133860 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-16858d5d-7330-47bc-ab4b-7ffe97a25197 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: 006b2255-2bfc-4f4d-808b-cf33efce0d3b] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:25:00.140304 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-16858d5d-7330-47bc-ab4b-7ffe97a25197 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:25:00.140757 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-16858d5d-7330-47bc-ab4b-7ffe97a25197 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:25:00.141551 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-16858d5d-7330-47bc-ab4b-7ffe97a25197 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:25:00.141986 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-16858d5d-7330-47bc-ab4b-7ffe97a25197 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:25:00.276863 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-16858d5d-7330-47bc-ab4b-7ffe97a25197 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:25:00.285149 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-16858d5d-7330-47bc-ab4b-7ffe97a25197 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b" status: 200 len: 1266 microversion: 2.1 time: 0.155700 Jul 05 16:25:00.285636 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 674/1113] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:25:00 2022] GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:25:01.302599 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-6ffa5e9f-f554-4338-918d-354b3cf46236 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:25:01.303208 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-6ffa5e9f-f554-4338-918d-354b3cf46236 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: 006b2255-2bfc-4f4d-808b-cf33efce0d3b] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:25:01.305160 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell0:SELECT=2 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:25:01.305858 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell0:SELECT=8 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:25:01.311066 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6ffa5e9f-f554-4338-918d-354b3cf46236 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:25:01.311522 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6ffa5e9f-f554-4338-918d-354b3cf46236 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:25:01.312278 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6ffa5e9f-f554-4338-918d-354b3cf46236 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:25:01.312717 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6ffa5e9f-f554-4338-918d-354b3cf46236 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:25:01.440270 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-6ffa5e9f-f554-4338-918d-354b3cf46236 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:25:01.447615 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-6ffa5e9f-f554-4338-918d-354b3cf46236 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b" status: 200 len: 1266 microversion: 2.1 time: 0.148831 Jul 05 16:25:01.448171 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 675/1114] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:25:01 2022] GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:25:02.464643 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-9c90e15e-8cf1-4aa6-912d-87cc25ca8c5b tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:25:02.465307 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-9c90e15e-8cf1-4aa6-912d-87cc25ca8c5b tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: 006b2255-2bfc-4f4d-808b-cf33efce0d3b] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:25:02.472244 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9c90e15e-8cf1-4aa6-912d-87cc25ca8c5b tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:25:02.472701 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9c90e15e-8cf1-4aa6-912d-87cc25ca8c5b tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:25:02.473514 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9c90e15e-8cf1-4aa6-912d-87cc25ca8c5b tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:25:02.473957 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-9c90e15e-8cf1-4aa6-912d-87cc25ca8c5b tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:25:02.601954 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-9c90e15e-8cf1-4aa6-912d-87cc25ca8c5b tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:25:02.610025 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-9c90e15e-8cf1-4aa6-912d-87cc25ca8c5b tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b" status: 200 len: 1266 microversion: 2.1 time: 0.149301 Jul 05 16:25:02.610591 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 676/1115] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:25:02 2022] GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:25:03.626655 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-70701279-2e9a-4421-978c-e00e7472b21a tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:25:03.627318 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-70701279-2e9a-4421-978c-e00e7472b21a tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: 006b2255-2bfc-4f4d-808b-cf33efce0d3b] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:25:03.633743 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-70701279-2e9a-4421-978c-e00e7472b21a tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:25:03.634190 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-70701279-2e9a-4421-978c-e00e7472b21a tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:25:03.634948 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-70701279-2e9a-4421-978c-e00e7472b21a tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:25:03.635380 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-70701279-2e9a-4421-978c-e00e7472b21a tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:25:03.768367 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-70701279-2e9a-4421-978c-e00e7472b21a tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:25:03.775897 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-70701279-2e9a-4421-978c-e00e7472b21a tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b" status: 200 len: 1266 microversion: 2.1 time: 0.153696 Jul 05 16:25:03.776473 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 677/1116] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:25:03 2022] GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:25:04.793110 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-dfae0466-e4cc-42ce-909b-b23223fa69e7 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:25:04.793722 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-dfae0466-e4cc-42ce-909b-b23223fa69e7 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: 006b2255-2bfc-4f4d-808b-cf33efce0d3b] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:25:04.800241 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dfae0466-e4cc-42ce-909b-b23223fa69e7 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:25:04.800954 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dfae0466-e4cc-42ce-909b-b23223fa69e7 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:25:04.801733 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dfae0466-e4cc-42ce-909b-b23223fa69e7 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:25:04.802176 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-dfae0466-e4cc-42ce-909b-b23223fa69e7 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:25:04.985010 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-dfae0466-e4cc-42ce-909b-b23223fa69e7 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:25:04.992629 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-dfae0466-e4cc-42ce-909b-b23223fa69e7 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b" status: 200 len: 1266 microversion: 2.1 time: 0.203340 Jul 05 16:25:04.993332 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 678/1117] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:25:04 2022] GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:25:05.353646 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-a2622a76-3a37-496b-83bd-4d7412786700 req-45e1a444-7e29-4b17-8acb-7d8b9b174c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "006b2255-2bfc-4f4d-808b-cf33efce0d3b", "name": "network-vif-plugged", "status": "completed", "tag": "bd0e93ea-99c5-40cb-a24f-6c4e5b679729"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:25:05.363973 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-a2622a76-3a37-496b-83bd-4d7412786700 req-45e1a444-7e29-4b17-8acb-7d8b9b174c04 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:25:05.364596 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-a2622a76-3a37-496b-83bd-4d7412786700 req-45e1a444-7e29-4b17-8acb-7d8b9b174c04 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:25:05.375853 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-a2622a76-3a37-496b-83bd-4d7412786700 req-45e1a444-7e29-4b17-8acb-7d8b9b174c04 service nova] Creating event network-vif-plugged:bd0e93ea-99c5-40cb-a24f-6c4e5b679729 for instance 006b2255-2bfc-4f4d-808b-cf33efce0d3b on hv-cinder-84875 Jul 05 16:25:05.381302 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-a2622a76-3a37-496b-83bd-4d7412786700 req-45e1a444-7e29-4b17-8acb-7d8b9b174c04 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031511 Jul 05 16:25:05.381903 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 679/1118] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:25:06.010522 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-557e6766-d78f-4a40-a804-149f9df34238 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:25:06.011165 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-557e6766-d78f-4a40-a804-149f9df34238 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: 006b2255-2bfc-4f4d-808b-cf33efce0d3b] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:25:06.017847 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-557e6766-d78f-4a40-a804-149f9df34238 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:25:06.018300 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-557e6766-d78f-4a40-a804-149f9df34238 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:25:06.019072 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-557e6766-d78f-4a40-a804-149f9df34238 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:25:06.019516 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-557e6766-d78f-4a40-a804-149f9df34238 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:25:06.147794 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-557e6766-d78f-4a40-a804-149f9df34238 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:25:06.155208 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-557e6766-d78f-4a40-a804-149f9df34238 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b" status: 200 len: 1266 microversion: 2.1 time: 0.148987 Jul 05 16:25:06.156282 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 680/1119] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:25:06 2022] GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:25:07.172348 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-6c73e9c4-7ee0-4877-9872-936bdccd64ba tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:25:07.173071 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-6c73e9c4-7ee0-4877-9872-936bdccd64ba tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: 006b2255-2bfc-4f4d-808b-cf33efce0d3b] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:25:07.179711 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6c73e9c4-7ee0-4877-9872-936bdccd64ba tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:25:07.180164 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6c73e9c4-7ee0-4877-9872-936bdccd64ba tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:25:07.181036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6c73e9c4-7ee0-4877-9872-936bdccd64ba tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:25:07.181477 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-6c73e9c4-7ee0-4877-9872-936bdccd64ba tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:25:07.314251 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-6c73e9c4-7ee0-4877-9872-936bdccd64ba tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:25:07.321832 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-6c73e9c4-7ee0-4877-9872-936bdccd64ba tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b" status: 200 len: 1453 microversion: 2.1 time: 0.153920 Jul 05 16:25:07.322402 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 681/1120] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:25:07 2022] GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:25:07.337876 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-051130b1-07ee-4af0-be52-c2813767af1f tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:25:07.338493 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-051130b1-07ee-4af0-be52-c2813767af1f tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: 006b2255-2bfc-4f4d-808b-cf33efce0d3b] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:25:07.344219 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-051130b1-07ee-4af0-be52-c2813767af1f tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:25:07.344670 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-051130b1-07ee-4af0-be52-c2813767af1f tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:25:07.345462 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-051130b1-07ee-4af0-be52-c2813767af1f tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:25:07.345904 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-051130b1-07ee-4af0-be52-c2813767af1f tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:25:07.472073 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-051130b1-07ee-4af0-be52-c2813767af1f tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:25:07.479795 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-051130b1-07ee-4af0-be52-c2813767af1f tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b" status: 200 len: 1453 microversion: 2.1 time: 0.145392 Jul 05 16:25:07.480366 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 682/1121] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:25:07 2022] GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b => generated 1453 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:25:09.410297 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-bd9b8e75-3813-4f97-8bb4-7f3ae3662f9e req-8065d803-4d0f-4fe9-9840-c428141d9af0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "006b2255-2bfc-4f4d-808b-cf33efce0d3b", "tag": "bd0e93ea-99c5-40cb-a24f-6c4e5b679729"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:25:09.418817 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-bd9b8e75-3813-4f97-8bb4-7f3ae3662f9e req-8065d803-4d0f-4fe9-9840-c428141d9af0 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:25:09.419331 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-bd9b8e75-3813-4f97-8bb4-7f3ae3662f9e req-8065d803-4d0f-4fe9-9840-c428141d9af0 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:25:09.432337 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-bd9b8e75-3813-4f97-8bb4-7f3ae3662f9e req-8065d803-4d0f-4fe9-9840-c428141d9af0 service nova] Creating event network-changed:bd0e93ea-99c5-40cb-a24f-6c4e5b679729 for instance 006b2255-2bfc-4f4d-808b-cf33efce0d3b on hv-cinder-84875 Jul 05 16:25:09.437335 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-bd9b8e75-3813-4f97-8bb4-7f3ae3662f9e req-8065d803-4d0f-4fe9-9840-c428141d9af0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031219 Jul 05 16:25:09.438032 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 683/1122] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:25:40.729113 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 16:25:40.729754 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Tue Jul 5 16:25:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 (ip 10.222.0.45) !!! Jul 05 16:26:37.988609 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:26:37.989413 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG dbcounter [-] [118320] Writing DB stats nova_cell1:SELECT=98 {{(pid=118320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 16:26:37.993813 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-683fc393-2606-4632-a7b9-028f53384a08 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:26:37.997422 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-683fc393-2606-4632-a7b9-028f53384a08 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: 006b2255-2bfc-4f4d-808b-cf33efce0d3b] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:26:38.002987 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-683fc393-2606-4632-a7b9-028f53384a08 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:26:38.003440 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-683fc393-2606-4632-a7b9-028f53384a08 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:26:38.004296 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-683fc393-2606-4632-a7b9-028f53384a08 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:26:38.004731 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-683fc393-2606-4632-a7b9-028f53384a08 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:26:38.029148 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-683fc393-2606-4632-a7b9-028f53384a08 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: 006b2255-2bfc-4f4d-808b-cf33efce0d3b] Going to try to terminate instance {{(pid=118320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 16:26:38.327423 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-683fc393-2606-4632-a7b9-028f53384a08 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "DELETE /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b" status: 204 len: 0 microversion: 2.1 time: 0.341542 Jul 05 16:26:38.328028 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 684/1123] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Jul 5 16:26:37 2022] DELETE /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 16:26:38.333087 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-d0ed01b2-5c77-4665-8fab-a26e77ca2300 req-662a5692-540b-4b8f-ae6d-74663854000f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "006b2255-2bfc-4f4d-808b-cf33efce0d3b", "tag": "bd0e93ea-99c5-40cb-a24f-6c4e5b679729"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:26:38.340841 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-d0ed01b2-5c77-4665-8fab-a26e77ca2300 req-662a5692-540b-4b8f-ae6d-74663854000f service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:26:38.341290 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-d0ed01b2-5c77-4665-8fab-a26e77ca2300 req-662a5692-540b-4b8f-ae6d-74663854000f service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:26:38.352227 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-d0ed01b2-5c77-4665-8fab-a26e77ca2300 req-662a5692-540b-4b8f-ae6d-74663854000f service nova] Creating event network-changed:bd0e93ea-99c5-40cb-a24f-6c4e5b679729 for instance 006b2255-2bfc-4f4d-808b-cf33efce0d3b on hv-cinder-84875 Jul 05 16:26:38.357364 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-d0ed01b2-5c77-4665-8fab-a26e77ca2300 req-662a5692-540b-4b8f-ae6d-74663854000f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027888 Jul 05 16:26:38.362221 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 685/1124] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:26:38.363520 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-21b677bd-2f17-4b40-a27a-04fad3b16965 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:26:38.364219 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-21b677bd-2f17-4b40-a27a-04fad3b16965 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: 006b2255-2bfc-4f4d-808b-cf33efce0d3b] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:26:38.370666 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-21b677bd-2f17-4b40-a27a-04fad3b16965 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:26:38.371120 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-21b677bd-2f17-4b40-a27a-04fad3b16965 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:26:38.372399 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-21b677bd-2f17-4b40-a27a-04fad3b16965 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:26:38.372861 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-21b677bd-2f17-4b40-a27a-04fad3b16965 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:26:38.511431 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-21b677bd-2f17-4b40-a27a-04fad3b16965 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:26:38.520112 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-21b677bd-2f17-4b40-a27a-04fad3b16965 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b" status: 200 len: 1578 microversion: 2.1 time: 0.160853 Jul 05 16:26:38.529470 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 686/1125] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:26:38 2022] GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:26:39.537413 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-f7bea1d9-03ae-4801-bec9-6246b3a7dfaa tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:26:39.538088 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-f7bea1d9-03ae-4801-bec9-6246b3a7dfaa tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: 006b2255-2bfc-4f4d-808b-cf33efce0d3b] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:26:39.544686 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f7bea1d9-03ae-4801-bec9-6246b3a7dfaa tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:26:39.545163 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f7bea1d9-03ae-4801-bec9-6246b3a7dfaa tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:26:39.545919 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f7bea1d9-03ae-4801-bec9-6246b3a7dfaa tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:26:39.546351 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-f7bea1d9-03ae-4801-bec9-6246b3a7dfaa tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:26:39.702135 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-f7bea1d9-03ae-4801-bec9-6246b3a7dfaa tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:26:39.709519 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-f7bea1d9-03ae-4801-bec9-6246b3a7dfaa tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b" status: 200 len: 1578 microversion: 2.1 time: 0.175955 Jul 05 16:26:39.710088 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 687/1126] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:26:39 2022] GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b => generated 1578 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:26:40.493311 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-795a1e9d-39e1-4f43-8d67-e4ab80f616bb req-cb7ac854-3960-42fd-80e6-c44cf26db511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "006b2255-2bfc-4f4d-808b-cf33efce0d3b", "name": "network-vif-deleted", "tag": "bd0e93ea-99c5-40cb-a24f-6c4e5b679729"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:26:40.501402 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-795a1e9d-39e1-4f43-8d67-e4ab80f616bb req-cb7ac854-3960-42fd-80e6-c44cf26db511 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:26:40.501847 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-795a1e9d-39e1-4f43-8d67-e4ab80f616bb req-cb7ac854-3960-42fd-80e6-c44cf26db511 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:26:40.512444 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-795a1e9d-39e1-4f43-8d67-e4ab80f616bb req-cb7ac854-3960-42fd-80e6-c44cf26db511 service nova] Creating event network-vif-deleted:bd0e93ea-99c5-40cb-a24f-6c4e5b679729 for instance 006b2255-2bfc-4f4d-808b-cf33efce0d3b on hv-cinder-84875 Jul 05 16:26:40.517698 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-795a1e9d-39e1-4f43-8d67-e4ab80f616bb req-cb7ac854-3960-42fd-80e6-c44cf26db511 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027406 Jul 05 16:26:40.517871 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 688/1127] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 16:26:40.728415 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-290915ef-3b1d-44a6-9ed6-522b23fec89a tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:26:40.729094 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-290915ef-3b1d-44a6-9ed6-522b23fec89a tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: 006b2255-2bfc-4f4d-808b-cf33efce0d3b] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:26:40.735865 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-290915ef-3b1d-44a6-9ed6-522b23fec89a tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:26:40.736554 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-290915ef-3b1d-44a6-9ed6-522b23fec89a tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:26:40.737357 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-290915ef-3b1d-44a6-9ed6-522b23fec89a tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:26:40.737799 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-290915ef-3b1d-44a6-9ed6-522b23fec89a tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:26:40.803810 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-290915ef-3b1d-44a6-9ed6-522b23fec89a tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:26:40.812089 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-290915ef-3b1d-44a6-9ed6-522b23fec89a tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b" status: 200 len: 1225 microversion: 2.1 time: 0.088326 Jul 05 16:26:40.812685 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 689/1128] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:26:40 2022] GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:26:41.828554 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-1303e40a-6c48-46ae-baa2-4d9330f15b3f tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:26:41.829331 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-1303e40a-6c48-46ae-baa2-4d9330f15b3f tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: 006b2255-2bfc-4f4d-808b-cf33efce0d3b] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:26:41.835538 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1303e40a-6c48-46ae-baa2-4d9330f15b3f tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:26:41.835988 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1303e40a-6c48-46ae-baa2-4d9330f15b3f tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:26:41.836748 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1303e40a-6c48-46ae-baa2-4d9330f15b3f tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:26:41.837316 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-1303e40a-6c48-46ae-baa2-4d9330f15b3f tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:26:41.850355 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-1303e40a-6c48-46ae-baa2-4d9330f15b3f tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] HTTP exception thrown: Instance 006b2255-2bfc-4f4d-808b-cf33efce0d3b could not be found. Jul 05 16:26:41.856376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-1303e40a-6c48-46ae-baa2-4d9330f15b3f tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Request method failure captured: Jul 05 16:26:41.856376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b HTTP/1.1 Jul 05 16:26:41.856376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:26:41.856376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:26:41.856376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:26:41.856376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:26:41.856376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:26:41.856376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:26:41.856376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:26:41.856376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:26:41.856376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGS5cHux0_5KVsliMHIxj7KjpuGF_grk3k2eQrue6KTMeaK4-HqMUO0gwWi0DPP1dfVotrRrgjYuIGKi8Jkqg75X752EKsPCvXektFNRT_xGyd7lplJ64TVk6hun_S1JiSqiARovrEqslD_BJ3G4lUUOjrXpQ9TF2s6cZ_araj5MAao Jul 05 16:26:41.856376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:26:41.856376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:26:41.856376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:26:41.856376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:26:41.856376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:26:41.856376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:26:41.856376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 85bf8c1d40a04aaf9e46cd7f1e58048a Jul 05 16:26:41.856376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-TestVolumeBootPattern-801191980 Jul 05 16:26:41.856376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:26:41.856376 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:26:41.858196 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_85bf8c1d40a04aaf9e46cd7f1e58048a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/85bf8c1d40a04aaf9e46cd7f1e58048a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/85bf8c1d40a04aaf9e46cd7f1e58048a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/85bf8c1d40a04aaf9e46cd7f1e58048a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:26:41.858196 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-TestVolumeBootPattern-801191980 Jul 05 16:26:41.858196 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 85bf8c1d40a04aaf9e46cd7f1e58048a Jul 05 16:26:41.858196 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-TestVolumeBootPattern-801191980 Jul 05 16:26:41.858196 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-TestVolumeBootPattern-801191980-project Jul 05 16:26:41.858196 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:26:41.858196 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:26:41.858196 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: b1cf6897a2a74b7c84b26bae868845f4 Jul 05 16:26:41.858196 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-TestVolumeBootPattern-801191980-project Jul 05 16:26:41.858196 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:26:41.858196 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance 006b2255-2bfc-4f4d-808b-cf33efce0d3b could not be found. Jul 05 16:26:41.858196 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': '006b2255-2bfc-4f4d-808b-cf33efce0d3b'} Jul 05 16:26:41.859115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:26:41.859115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:26:41.859115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:26:41.859115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:26:41.859115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:26:41.859115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:26:41.859115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:26:41.859115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:26:41.859115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:26:41.859115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:26:41.859115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 006b2255-2bfc-4f4d-808b-cf33efce0d3b could not be found. Jul 05 16:26:41.859115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:26:41.859115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:26:41.859115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:26:41.859115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:26:41.859115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:26:41.859115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:26:41.859115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:26:41.859115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:26:41.859115 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:26:41.860621 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:26:41.860621 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 16:26:41.860621 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 16:26:41.860621 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:26:41.860621 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:26:41.860621 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:26:41.860621 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:26:41.860621 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 006b2255-2bfc-4f4d-808b-cf33efce0d3b could not be found. Jul 05 16:26:41.860621 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:26:41.860621 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:26:41.860621 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:26:41.860621 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:26:41.860621 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:26:41.860621 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:26:41.860621 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:26:41.860621 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:26:41.860621 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 006b2255-2bfc-4f4d-808b-cf33efce0d3b could not be found. Jul 05 16:26:41.860621 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:26:41.863169 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-1303e40a-6c48-46ae-baa2-4d9330f15b3f tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Returning 404 to user: Instance 006b2255-2bfc-4f4d-808b-cf33efce0d3b could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:26:41.863169 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-1303e40a-6c48-46ae-baa2-4d9330f15b3f tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b" status: 404 len: 111 microversion: 2.1 time: 0.028939 Jul 05 16:26:41.863169 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 690/1129] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:26:41 2022] GET /compute/v2.1/servers/006b2255-2bfc-4f4d-808b-cf33efce0d3b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 16:26:45.150424 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-ecc528b1-c77d-4bbb-b4d5-3d1163b5f8c9 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:26:45.151001 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-ecc528b1-c77d-4bbb-b4d5-3d1163b5f8c9 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: afba3565-7b71-4a48-a24a-1a42f118be22] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:26:45.157314 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ecc528b1-c77d-4bbb-b4d5-3d1163b5f8c9 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:26:45.157773 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ecc528b1-c77d-4bbb-b4d5-3d1163b5f8c9 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:26:45.158531 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ecc528b1-c77d-4bbb-b4d5-3d1163b5f8c9 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:26:45.158966 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-ecc528b1-c77d-4bbb-b4d5-3d1163b5f8c9 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:26:45.185642 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-ecc528b1-c77d-4bbb-b4d5-3d1163b5f8c9 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: afba3565-7b71-4a48-a24a-1a42f118be22] Going to try to terminate instance {{(pid=118320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 16:26:45.503690 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-ecc528b1-c77d-4bbb-b4d5-3d1163b5f8c9 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "DELETE /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22" status: 204 len: 0 microversion: 2.1 time: 0.356823 Jul 05 16:26:45.504661 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 691/1130] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Jul 5 16:26:45 2022] DELETE /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 05 16:26:45.509420 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-9b1bd486-6ca3-4bf9-bee9-0d063f00fa95 req-9bd4a7a8-f457-490b-a82f-d4d265ec653a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afba3565-7b71-4a48-a24a-1a42f118be22", "tag": "23599f51-0ae0-4fa3-921f-4883717fbde6"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:26:45.517305 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-9b1bd486-6ca3-4bf9-bee9-0d063f00fa95 req-9bd4a7a8-f457-490b-a82f-d4d265ec653a service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:26:45.517744 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-9b1bd486-6ca3-4bf9-bee9-0d063f00fa95 req-9bd4a7a8-f457-490b-a82f-d4d265ec653a service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:26:45.528532 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-9b1bd486-6ca3-4bf9-bee9-0d063f00fa95 req-9bd4a7a8-f457-490b-a82f-d4d265ec653a service nova] Creating event network-changed:23599f51-0ae0-4fa3-921f-4883717fbde6 for instance afba3565-7b71-4a48-a24a-1a42f118be22 on hv-cinder-84875 Jul 05 16:26:45.533776 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-9b1bd486-6ca3-4bf9-bee9-0d063f00fa95 req-9bd4a7a8-f457-490b-a82f-d4d265ec653a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028039 Jul 05 16:26:45.534448 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 692/1131] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:26:45.540256 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-47d1c297-436d-47d8-9154-9cefbcad5991 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:26:45.540256 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-47d1c297-436d-47d8-9154-9cefbcad5991 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: afba3565-7b71-4a48-a24a-1a42f118be22] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:26:45.546661 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-47d1c297-436d-47d8-9154-9cefbcad5991 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:26:45.547095 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-47d1c297-436d-47d8-9154-9cefbcad5991 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:26:45.547859 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-47d1c297-436d-47d8-9154-9cefbcad5991 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:26:45.548296 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-47d1c297-436d-47d8-9154-9cefbcad5991 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:26:45.679186 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-47d1c297-436d-47d8-9154-9cefbcad5991 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:26:45.686651 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-47d1c297-436d-47d8-9154-9cefbcad5991 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22" status: 200 len: 1578 microversion: 2.1 time: 0.151122 Jul 05 16:26:45.687220 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 693/1132] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:26:45 2022] GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22 => generated 1578 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 16:26:46.704480 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-743a1c7b-f7ad-4b1d-b24e-280d39fd22b5 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:26:46.705134 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-743a1c7b-f7ad-4b1d-b24e-280d39fd22b5 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: afba3565-7b71-4a48-a24a-1a42f118be22] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:26:46.711698 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-743a1c7b-f7ad-4b1d-b24e-280d39fd22b5 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:26:46.712144 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-743a1c7b-f7ad-4b1d-b24e-280d39fd22b5 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:26:46.712944 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-743a1c7b-f7ad-4b1d-b24e-280d39fd22b5 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:26:46.713380 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-743a1c7b-f7ad-4b1d-b24e-280d39fd22b5 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:26:46.873812 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-743a1c7b-f7ad-4b1d-b24e-280d39fd22b5 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:26:46.881368 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-743a1c7b-f7ad-4b1d-b24e-280d39fd22b5 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22" status: 200 len: 1578 microversion: 2.1 time: 0.181397 Jul 05 16:26:46.881939 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 694/1133] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:26:46 2022] GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22 => generated 1578 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:26:47.841849 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [req-c1fbf537-53c7-4c90-a4e6-42d74a7f9a31 req-4c81f9b3-970d-4743-94b6-7963205e3ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afba3565-7b71-4a48-a24a-1a42f118be22", "name": "network-vif-deleted", "tag": "23599f51-0ae0-4fa3-921f-4883717fbde6"}]} {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 16:26:47.850233 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-c1fbf537-53c7-4c90-a4e6-42d74a7f9a31 req-4c81f9b3-970d-4743-94b6-7963205e3ac8 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:26:47.855672 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [req-c1fbf537-53c7-4c90-a4e6-42d74a7f9a31 req-4c81f9b3-970d-4743-94b6-7963205e3ac8 service nova] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:26:47.861572 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.compute.server_external_events [req-c1fbf537-53c7-4c90-a4e6-42d74a7f9a31 req-4c81f9b3-970d-4743-94b6-7963205e3ac8 service nova] Creating event network-vif-deleted:23599f51-0ae0-4fa3-921f-4883717fbde6 for instance afba3565-7b71-4a48-a24a-1a42f118be22 on hv-cinder-84875 Jul 05 16:26:47.866452 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [req-c1fbf537-53c7-4c90-a4e6-42d74a7f9a31 req-4c81f9b3-970d-4743-94b6-7963205e3ac8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028937 Jul 05 16:26:47.867060 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 695/1134] 10.222.0.45 () {64 vars in 1317 bytes} [Tue Jul 5 16:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 16:26:47.897929 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-df19cbc0-84ea-4de9-a031-d4c2e4618f00 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:26:47.898573 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-df19cbc0-84ea-4de9-a031-d4c2e4618f00 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: afba3565-7b71-4a48-a24a-1a42f118be22] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:26:47.904872 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-df19cbc0-84ea-4de9-a031-d4c2e4618f00 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:26:47.905332 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-df19cbc0-84ea-4de9-a031-d4c2e4618f00 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:26:47.906096 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-df19cbc0-84ea-4de9-a031-d4c2e4618f00 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:26:47.906538 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-df19cbc0-84ea-4de9-a031-d4c2e4618f00 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:26:47.974015 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.policy [None req-df19cbc0-84ea-4de9-a031-d4c2e4618f00 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf6897a2a74b7c84b26bae868845f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8c1d40a04aaf9e46cd7f1e58048a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 16:26:47.981757 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-df19cbc0-84ea-4de9-a031-d4c2e4618f00 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22" status: 200 len: 1391 microversion: 2.1 time: 0.087956 Jul 05 16:26:47.982333 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 696/1135] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:26:47 2022] GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22 => generated 1391 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 16:26:48.998254 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-0063141e-c460-409b-9bdc-7cb9b9a79074 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:26:48.998887 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-0063141e-c460-409b-9bdc-7cb9b9a79074 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: afba3565-7b71-4a48-a24a-1a42f118be22] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:26:49.005408 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0063141e-c460-409b-9bdc-7cb9b9a79074 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:26:49.005862 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0063141e-c460-409b-9bdc-7cb9b9a79074 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:26:49.006625 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0063141e-c460-409b-9bdc-7cb9b9a79074 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:26:49.007064 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-0063141e-c460-409b-9bdc-7cb9b9a79074 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:26:49.020443 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-0063141e-c460-409b-9bdc-7cb9b9a79074 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] HTTP exception thrown: Instance afba3565-7b71-4a48-a24a-1a42f118be22 could not be found. Jul 05 16:26:49.022078 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-0063141e-c460-409b-9bdc-7cb9b9a79074 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Request method failure captured: Jul 05 16:26:49.022078 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22 HTTP/1.1 Jul 05 16:26:49.022078 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:26:49.022078 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:26:49.022078 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:26:49.022078 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:26:49.022078 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:26:49.022078 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:26:49.022078 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:26:49.022078 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:26:49.022078 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGS5cHux0_5KVsliMHIxj7KjpuGF_grk3k2eQrue6KTMeaK4-HqMUO0gwWi0DPP1dfVotrRrgjYuIGKi8Jkqg75X752EKsPCvXektFNRT_xGyd7lplJ64TVk6hun_S1JiSqiARovrEqslD_BJ3G4lUUOjrXpQ9TF2s6cZ_araj5MAao Jul 05 16:26:49.022078 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:26:49.022078 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:26:49.022078 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:26:49.022078 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:26:49.022078 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:26:49.022078 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:26:49.022078 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 85bf8c1d40a04aaf9e46cd7f1e58048a Jul 05 16:26:49.022078 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-TestVolumeBootPattern-801191980 Jul 05 16:26:49.022078 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:26:49.022078 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:26:49.023751 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_85bf8c1d40a04aaf9e46cd7f1e58048a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/85bf8c1d40a04aaf9e46cd7f1e58048a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/85bf8c1d40a04aaf9e46cd7f1e58048a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/85bf8c1d40a04aaf9e46cd7f1e58048a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:26:49.023751 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-TestVolumeBootPattern-801191980 Jul 05 16:26:49.023751 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 85bf8c1d40a04aaf9e46cd7f1e58048a Jul 05 16:26:49.023751 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-TestVolumeBootPattern-801191980 Jul 05 16:26:49.023751 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-TestVolumeBootPattern-801191980-project Jul 05 16:26:49.023751 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:26:49.023751 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:26:49.023751 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: b1cf6897a2a74b7c84b26bae868845f4 Jul 05 16:26:49.023751 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-TestVolumeBootPattern-801191980-project Jul 05 16:26:49.023751 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:26:49.023751 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance afba3565-7b71-4a48-a24a-1a42f118be22 could not be found. Jul 05 16:26:49.023751 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': 'afba3565-7b71-4a48-a24a-1a42f118be22'} Jul 05 16:26:49.024705 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:26:49.024705 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:26:49.024705 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:26:49.024705 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:26:49.024705 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:26:49.024705 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:26:49.024705 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:26:49.024705 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:26:49.024705 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:26:49.024705 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:26:49.024705 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afba3565-7b71-4a48-a24a-1a42f118be22 could not be found. Jul 05 16:26:49.024705 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:26:49.024705 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:26:49.024705 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:26:49.024705 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:26:49.024705 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:26:49.024705 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:26:49.024705 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:26:49.024705 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:26:49.024705 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:26:49.026362 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:26:49.026362 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 16:26:49.026362 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 16:26:49.026362 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:26:49.026362 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:26:49.026362 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:26:49.026362 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:26:49.026362 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afba3565-7b71-4a48-a24a-1a42f118be22 could not be found. Jul 05 16:26:49.026362 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:26:49.026362 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:26:49.026362 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:26:49.026362 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:26:49.026362 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:26:49.026362 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:26:49.026362 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:26:49.026362 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:26:49.026362 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afba3565-7b71-4a48-a24a-1a42f118be22 could not be found. Jul 05 16:26:49.026362 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:26:49.027931 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-0063141e-c460-409b-9bdc-7cb9b9a79074 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Returning 404 to user: Instance afba3565-7b71-4a48-a24a-1a42f118be22 could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:26:49.027931 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-0063141e-c460-409b-9bdc-7cb9b9a79074 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22" status: 404 len: 111 microversion: 2.1 time: 0.029314 Jul 05 16:26:49.027931 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 697/1136] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:26:48 2022] GET /compute/v2.1/servers/afba3565-7b71-4a48-a24a-1a42f118be22 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 16:26:49.569384 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-bc696d23-8727-4985-8bee-6053816077d1 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:26:49.569931 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-bc696d23-8727-4985-8bee-6053816077d1 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:26:49.576542 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bc696d23-8727-4985-8bee-6053816077d1 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:26:49.577026 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bc696d23-8727-4985-8bee-6053816077d1 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:26:49.577800 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bc696d23-8727-4985-8bee-6053816077d1 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:26:49.578240 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-bc696d23-8727-4985-8bee-6053816077d1 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:26:49.591450 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-bc696d23-8727-4985-8bee-6053816077d1 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] HTTP exception thrown: Instance f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 could not be found. Jul 05 16:26:49.593036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-bc696d23-8727-4985-8bee-6053816077d1 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Request method failure captured: Jul 05 16:26:49.593036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: DELETE /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 HTTP/1.1 Jul 05 16:26:49.593036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:26:49.593036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:26:49.593036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:26:49.593036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:26:49.593036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:26:49.593036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:26:49.593036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:26:49.593036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:26:49.593036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGS5cHux0_5KVsliMHIxj7KjpuGF_grk3k2eQrue6KTMeaK4-HqMUO0gwWi0DPP1dfVotrRrgjYuIGKi8Jkqg75X752EKsPCvXektFNRT_xGyd7lplJ64TVk6hun_S1JiSqiARovrEqslD_BJ3G4lUUOjrXpQ9TF2s6cZ_araj5MAao Jul 05 16:26:49.593036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:26:49.593036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:26:49.593036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:26:49.593036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:26:49.593036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:26:49.593036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:26:49.593036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 85bf8c1d40a04aaf9e46cd7f1e58048a Jul 05 16:26:49.593036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-TestVolumeBootPattern-801191980 Jul 05 16:26:49.593036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:26:49.593036 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:26:49.594748 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_85bf8c1d40a04aaf9e46cd7f1e58048a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/85bf8c1d40a04aaf9e46cd7f1e58048a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/85bf8c1d40a04aaf9e46cd7f1e58048a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/85bf8c1d40a04aaf9e46cd7f1e58048a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:26:49.594748 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-TestVolumeBootPattern-801191980 Jul 05 16:26:49.594748 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 85bf8c1d40a04aaf9e46cd7f1e58048a Jul 05 16:26:49.594748 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-TestVolumeBootPattern-801191980 Jul 05 16:26:49.594748 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-TestVolumeBootPattern-801191980-project Jul 05 16:26:49.594748 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:26:49.594748 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:26:49.594748 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: b1cf6897a2a74b7c84b26bae868845f4 Jul 05 16:26:49.594748 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-TestVolumeBootPattern-801191980-project Jul 05 16:26:49.594748 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:26:49.594748 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 could not be found. Jul 05 16:26:49.594748 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': 'f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8'} Jul 05 16:26:49.595855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:26:49.595855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:26:49.595855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:26:49.595855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:26:49.595855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:26:49.595855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:26:49.595855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:26:49.595855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:26:49.595855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:26:49.595855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:26:49.595855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 could not be found. Jul 05 16:26:49.595855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:26:49.595855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:26:49.595855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:26:49.595855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:26:49.595855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:26:49.595855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:26:49.595855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:26:49.595855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:26:49.595855 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:26:49.597494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:26:49.597494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 16:26:49.597494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 16:26:49.597494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 16:26:49.597494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 16:26:49.597494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:26:49.597494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:26:49.597494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:26:49.597494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:26:49.597494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 could not be found. Jul 05 16:26:49.597494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:26:49.597494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:26:49.597494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:26:49.597494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:26:49.597494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:26:49.597494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:26:49.597494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:26:49.597494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:26:49.597494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 could not be found. Jul 05 16:26:49.597494 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:26:49.599262 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-bc696d23-8727-4985-8bee-6053816077d1 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Returning 404 to user: Instance f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:26:49.599262 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-bc696d23-8727-4985-8bee-6053816077d1 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8" status: 404 len: 111 microversion: 2.1 time: 0.028913 Jul 05 16:26:49.599262 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 698/1137] 10.222.0.45 () {58 vars in 1238 bytes} [Tue Jul 5 16:26:49 2022] DELETE /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 16:26:49.602367 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-d92bc021-8613-4675-a592-2b202f708136 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:26:49.602981 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.compute.api [None req-d92bc021-8613-4675-a592-2b202f708136 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] [instance: f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8] Fetching instance by UUID {{(pid=118320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 16:26:49.608428 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d92bc021-8613-4675-a592-2b202f708136 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:26:49.608925 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d92bc021-8613-4675-a592-2b202f708136 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:26:49.609686 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d92bc021-8613-4675-a592-2b202f708136 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 16:26:49.610127 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG oslo_concurrency.lockutils [None req-d92bc021-8613-4675-a592-2b202f708136 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Lock "095eb995-5888-495e-a6b9-faa45b31bc81" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 16:26:49.623537 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.wsgi [None req-d92bc021-8613-4675-a592-2b202f708136 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] HTTP exception thrown: Instance f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 could not be found. Jul 05 16:26:49.625040 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-d92bc021-8613-4675-a592-2b202f708136 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Request method failure captured: Jul 05 16:26:49.625040 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: request: GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 HTTP/1.1 Jul 05 16:26:49.625040 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept: application/json Jul 05 16:26:49.625040 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Accept-Encoding: identity Jul 05 16:26:49.625040 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Connection: close Jul 05 16:26:49.625040 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Length: 0 Jul 05 16:26:49.625040 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Content-Type: application/json Jul 05 16:26:49.625040 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Host: 10.222.0.45 Jul 05 16:26:49.625040 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Openstack-System-Scope: None Jul 05 16:26:49.625040 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: User-Agent: python-urllib3/1.26.9 Jul 05 16:26:49.625040 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Auth-Token: gAAAAABixGS5cHux0_5KVsliMHIxj7KjpuGF_grk3k2eQrue6KTMeaK4-HqMUO0gwWi0DPP1dfVotrRrgjYuIGKi8Jkqg75X752EKsPCvXektFNRT_xGyd7lplJ64TVk6hun_S1JiSqiARovrEqslD_BJ3G4lUUOjrXpQ9TF2s6cZ_araj5MAao Jul 05 16:26:49.625040 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Id: None Jul 05 16:26:49.625040 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Domain-Name: None Jul 05 16:26:49.625040 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Identity-Status: Confirmed Jul 05 16:26:49.625040 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Is-Admin-Project: True Jul 05 16:26:49.625040 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Id: default Jul 05 16:26:49.625040 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Domain-Name: Default Jul 05 16:26:49.625040 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Id: 85bf8c1d40a04aaf9e46cd7f1e58048a Jul 05 16:26:49.625040 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Project-Name: tempest-TestVolumeBootPattern-801191980 Jul 05 16:26:49.625040 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Role: reader,member Jul 05 16:26:49.625040 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Roles: reader,member Jul 05 16:26:49.626869 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_85bf8c1d40a04aaf9e46cd7f1e58048a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/85bf8c1d40a04aaf9e46cd7f1e58048a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/85bf8c1d40a04aaf9e46cd7f1e58048a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/85bf8c1d40a04aaf9e46cd7f1e58048a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Jul 05 16:26:49.626869 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant: tempest-TestVolumeBootPattern-801191980 Jul 05 16:26:49.626869 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Id: 85bf8c1d40a04aaf9e46cd7f1e58048a Jul 05 16:26:49.626869 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-Tenant-Name: tempest-TestVolumeBootPattern-801191980 Jul 05 16:26:49.626869 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User: tempest-TestVolumeBootPattern-801191980-project Jul 05 16:26:49.626869 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Id: default Jul 05 16:26:49.626869 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Domain-Name: Default Jul 05 16:26:49.626869 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Id: b1cf6897a2a74b7c84b26bae868845f4 Jul 05 16:26:49.626869 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: X-User-Name: tempest-TestVolumeBootPattern-801191980-project Jul 05 16:26:49.626869 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: method: > Jul 05 16:26:49.626869 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: exception: Instance f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 could not be found. Jul 05 16:26:49.626869 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: action_args: {'id': 'f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8'} Jul 05 16:26:49.627929 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 16:26:49.627929 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:26:49.627929 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 16:26:49.627929 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 16:26:49.627929 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 16:26:49.627929 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 16:26:49.627929 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 16:26:49.627929 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 16:26:49.627929 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 16:26:49.627929 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 16:26:49.627929 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 could not be found. Jul 05 16:26:49.627929 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:26:49.627929 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:26:49.627929 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:26:49.627929 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:26:49.627929 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:26:49.627929 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:26:49.627929 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 16:26:49.627929 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 16:26:49.627929 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 16:26:49.629718 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 16:26:49.629718 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 16:26:49.629718 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 16:26:49.629718 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 16:26:49.629718 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 16:26:49.629718 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 16:26:49.629718 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 16:26:49.629718 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 could not be found. Jul 05 16:26:49.629718 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:26:49.629718 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 16:26:49.629718 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:26:49.629718 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 16:26:49.629718 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 16:26:49.629718 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 16:26:49.629718 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 16:26:49.629718 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 16:26:49.629718 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 could not be found. Jul 05 16:26:49.629718 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: ERROR nova.api.openstack.wsgi Jul 05 16:26:49.631217 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-d92bc021-8613-4675-a592-2b202f708136 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Returning 404 to user: Instance f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 could not be found. {{(pid=118320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 16:26:49.631217 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-d92bc021-8613-4675-a592-2b202f708136 tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8" status: 404 len: 111 microversion: 2.1 time: 0.027481 Jul 05 16:26:49.631217 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 699/1138] 10.222.0.45 () {58 vars in 1235 bytes} [Tue Jul 5 16:26:49 2022] GET /compute/v2.1/servers/f25de1fd-7dc8-4c17-98e9-1a502ef1e3d8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 16:26:51.097239 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: DEBUG nova.api.openstack.wsgi [None req-3772601d-c6ba-41e0-bfd4-22ffaaca662e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] Calling method '.version_select at 0x7f3087b85160>' {{(pid=118320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 16:26:51.201475 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO nova.api.openstack.requestlog [None req-3772601d-c6ba-41e0-bfd4-22ffaaca662e tempest-TestVolumeBootPattern-801191980 tempest-TestVolumeBootPattern-801191980-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1168178998" status: 202 len: 0 microversion: 2.1 time: 0.108094 Jul 05 16:26:51.202064 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: [pid: 118320|app: 0|req: 700/1139] 10.222.0.45 () {58 vars in 1262 bytes} [Tue Jul 5 16:26:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1168178998 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 05 16:27:22.014385 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 16:27:22.015025 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Tue Jul 5 16:27:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 (ip 10.222.0.45) !!! Jul 05 16:27:24.798605 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 16:27:24.799173 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Tue Jul 5 16:27:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 05 16:27:42.098544 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 16:27:42.099158 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Tue Jul 5 16:27:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 (ip 10.222.0.45) !!! Jul 05 16:28:56.675858 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 16:28:56.676385 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Tue Jul 5 16:28:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 05 16:29:00.737459 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 16:29:00.738052 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Tue Jul 5 16:29:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 (ip 10.222.0.45) !!! Jul 05 16:29:19.955155 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 16:29:19.955778 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Tue Jul 5 16:29:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 05 16:30:42.022614 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 16:30:42.023210 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Tue Jul 5 16:30:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 (ip 10.222.0.45) !!! Jul 05 16:30:44.806793 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 16:30:44.807313 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Tue Jul 5 16:30:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 05 16:31:02.108172 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 16:31:02.108742 dv-cinder-848759-1-iscsi devstack@n-api.service[118319]: Tue Jul 5 16:31:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c0bbf5ec-0bd0-47c0-a3cb-a474a110ff66 (ip 10.222.0.45) !!! Jul 05 16:32:16.683554 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 16:32:16.684069 dv-cinder-848759-1-iscsi devstack@n-api.service[118320]: Tue Jul 5 16:32:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!